-- Logs begin at Thu 2021-11-11 00:23:22 UTC, end at Thu 2021-11-11 01:24:50 UTC. -- Nov 11 00:54:05.409142 dv-cinder-817085-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 11 00:54:05.418910 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 11 00:54:05 2021] *** Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: nodename: dv-cinder-817085-3-iscsi Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: machine: x86_64 Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: clock source: unix Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: pcre jit disabled Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: detected number of CPU cores: 4 Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: current working directory: / Nov 11 00:54:05.420832 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: detected binary path: /usr/bin/uwsgi-core Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: your processes number limit is 47680 Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: your memory page size is 4096 bytes Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: detected max file descriptor number: 2048 Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: lock engine: pthread robust mutexes Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: thunder lock: enabled Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 11 00:54:05.421503 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 11 00:54:05.466506 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: Python main interpreter initialized at 0x55db090f69c0 Nov 11 00:54:05.466506 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: python threads support enabled Nov 11 00:54:05.466506 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: your server socket listen backlog is limited to 100 connections Nov 11 00:54:05.466506 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: your mercy for graceful operations on workers is 90 seconds Nov 11 00:54:05.466879 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: mapped 403077 bytes (393 KB) for 2 cores Nov 11 00:54:05.466981 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: *** Operational MODE: preforking *** Nov 11 00:54:05.467199 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: *** uWSGI is running in multiple interpreter mode *** Nov 11 00:54:05.467199 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: spawned uWSGI master process (pid: 100875) Nov 11 00:54:05.467399 dv-cinder-817085-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 11 00:54:05.468436 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: spawned uWSGI worker 1 (pid: 100876, cores: 1) Nov 11 00:54:05.468436 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: spawned uWSGI worker 2 (pid: 100877, cores: 1) Nov 11 00:54:05.468436 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 11 00:54:07.130496 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 00:54:07.130496 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: from cryptography.utils import int_from_bytes Nov 11 00:54:07.131136 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 00:54:07.131136 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: from cryptography.utils import int_from_bytes Nov 11 00:54:07.131604 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 00:54:07.131604 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: from cryptography.utils import int_from_bytes Nov 11 00:54:07.131780 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 00:54:07.131780 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: from cryptography.utils import int_from_bytes Nov 11 00:54:09.630314 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 00:54:09.630939 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 00:54:09.631050 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 00:54:09.631050 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 00:54:09.631477 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 00:54:09.631548 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 00:54:09.631623 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 00:54:09.631623 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 00:54:09.631748 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 00:54:09.631959 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 00:54:09.632056 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.632318 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.632410 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.632645 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.632800 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633005 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633113 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633270 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633360 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633576 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633669 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633892 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.633981 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.634208 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.634292 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.634624 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635109 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635109 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635269 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635412 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635497 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635752 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.635837 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-3-iscsi {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.636078 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-3-iscsi {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.636177 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.636403 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.636494 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.636712 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.636802 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637022 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637122 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637335 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637435 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637637 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637720 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.637948 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.638038 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.638253 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.638448 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.638764 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.638909 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.639129 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.639243 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.639436 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.639575 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.639748 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.639875 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.640088 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.640179 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.640401 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.640493 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.640720 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.640820 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641026 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641117 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641334 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641429 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641639 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641729 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.641948 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.642037 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-3-iscsi {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.642342 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.642475 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-3-iscsi {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.642655 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.642755 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.642983 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.643079 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.643298 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.643466 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.643691 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.643774 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.643997 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.644094 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.644303 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.644393 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.644626 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.644711 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.644966 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645065 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645254 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645339 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645571 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645657 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645888 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.645985 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.646203 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.646288 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.646502 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.646592 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.646807 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.646894 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.647135 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.647219 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.647444 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.647550 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.647742 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.647828 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648043 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648128 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648290 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648376 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648576 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648684 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648882 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.648970 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.649204 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.649291 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.649520 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.649608 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.649770 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.649862 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.650017 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.650716 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651230 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651329 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651410 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651489 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651671 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651758 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.651979 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652074 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652286 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652370 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652592 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652676 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652894 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.652997 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.653199 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.653293 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.653498 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.653592 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.653799 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.653884 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.654102 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.654193 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.654410 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.654492 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.654719 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.654812 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655044 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655144 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655359 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655450 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655678 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655763 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.655993 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.656090 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.656297 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.656388 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.656611 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.656694 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.656933 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657025 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657237 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657327 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657547 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657648 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657861 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.657945 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.658165 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.658256 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.658466 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.658556 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.658769 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.658894 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659096 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659183 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659418 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659503 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659716 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659801 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.659962 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660049 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660260 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660351 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660559 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660649 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660868 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.660961 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.661166 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.661256 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.661469 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.661566 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.661768 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.661852 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662062 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662161 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662360 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662449 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662659 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662742 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.662975 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663079 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663283 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663386 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663581 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663667 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663882 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.663975 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.664181 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.664265 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.664480 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.664563 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.664779 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.664873 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.665079 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.665160 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.665402 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.665532 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.665741 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.666383 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.666614 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.666718 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.666966 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.667084 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.667281 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.667397 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.667587 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.667717 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.667908 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668023 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668213 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668328 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668516 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668647 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668834 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.668940 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.669142 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.669323 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.669442 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.669536 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.669759 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.669846 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.670063 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.670157 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.670368 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.670454 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.670686 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.670790 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671006 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671105 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671312 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671414 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671619 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671704 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.671922 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672016 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672222 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672309 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672521 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672615 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672817 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.672903 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.673116 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.673206 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.673411 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.673505 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.673710 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.673795 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674003 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674088 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674299 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674401 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674616 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674719 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.674917 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675021 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675243 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675342 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675548 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675641 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675850 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.675935 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.676167 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 00:54:09.676263 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.676493 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.676585 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.676820 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.676903 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.677126 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.677219 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.677454 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.677540 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.677781 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.677873 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.678092 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.678178 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.678398 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.678485 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.678708 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.678800 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679039 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679145 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679347 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679451 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679655 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679749 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.679960 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680053 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680267 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680351 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680579 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680672 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680897 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.680985 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.681208 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.681327 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.681554 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.681651 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.681865 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682024 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682183 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682309 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682493 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682624 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682809 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.682980 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.683158 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.683290 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.683477 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.683674 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.683785 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684021 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684109 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684361 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684448 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684674 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684762 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.684996 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.685083 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.685305 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.685392 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.685624 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.685718 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.685937 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.686024 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.686247 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.686342 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.686557 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.686651 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.686888 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687008 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687221 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687322 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687532 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687625 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687863 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.687957 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.688175 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.688270 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.688489 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.688573 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.688790 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.688875 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.689092 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.689191 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.689395 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.689488 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.689701 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.689785 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690000 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690086 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690314 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690406 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690640 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690732 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.690984 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.691131 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.691295 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.691381 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.691599 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.691691 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.691906 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692002 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692213 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692300 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692515 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692601 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692823 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.692917 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.693130 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.693214 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.693431 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.693525 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.693751 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.693846 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694057 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694144 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694358 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694455 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694676 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694771 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.694998 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.695088 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.695304 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.695403 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.695617 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.695703 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.695924 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696018 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696231 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696329 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696537 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696629 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696857 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.696958 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.697296 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.697390 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.697665 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.697760 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.697983 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.698082 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.698313 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.698408 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.698619 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.698707 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.698973 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699064 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699287 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699376 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699602 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699691 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699906 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.699991 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.700213 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.700309 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.700515 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.700600 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.700819 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.700916 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.701121 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.701213 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.701426 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.701510 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.701728 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.701821 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702029 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702120 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702329 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702419 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702630 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702727 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.702930 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703044 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703273 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703360 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703581 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703678 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703885 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.703972 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.704188 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.704281 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.704490 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.704577 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.704829 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.704913 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.705132 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.705217 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.705468 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.705555 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.705802 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.705889 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.706117 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.706202 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.706439 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.706531 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.706748 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.707116 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.707348 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.707433 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.707656 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.707742 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.707981 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708119 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708268 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708385 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708576 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708668 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708891 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.708977 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.709198 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.709291 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.709513 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.709644 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.709818 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.709910 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.710135 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.710229 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.710443 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.710527 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.710756 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.710847 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.711079 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.711185 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.711393 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.711481 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.711729 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.711816 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.712057 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.712154 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.712368 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.712452 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.713226 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.713355 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.713602 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.713686 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.713920 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714017 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714229 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714316 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714538 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714626 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714847 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.714935 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.715181 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.715268 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.715498 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.715584 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.715805 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.715890 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.716122 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.716209 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.716430 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.716524 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.716751 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.716835 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717056 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717149 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717371 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717456 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717672 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717757 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.717982 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.718077 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.718307 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.718396 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.718636 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.718722 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.718962 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719063 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719272 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719365 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719590 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719711 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719896 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.719991 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.720202 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.720295 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.720506 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.720590 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.720806 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.720893 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.721109 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.721197 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.721413 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.721505 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.721723 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.721811 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722028 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722114 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722332 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722416 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722632 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722719 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.722939 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.723050 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.723264 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.723351 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.723564 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.723651 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.723874 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724012 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724168 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724264 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724483 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724576 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724789 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.724881 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.725105 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.725199 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.725422 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.725509 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.725721 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.725806 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726021 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726121 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726341 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726434 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726643 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726727 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.726972 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.727075 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.727265 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.727352 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.727565 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.727651 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.727901 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.728001 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.728230 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.728847 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.729063 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.729177 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.729404 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.729555 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.729722 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.729881 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730028 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730191 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730339 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730506 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730647 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730816 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.730968 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.731158 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.731292 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.731481 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.731581 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.731795 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.731899 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.732103 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.732208 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.732413 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.732509 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.732719 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.732821 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733027 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733122 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733335 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733430 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733651 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733744 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.733973 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734063 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734256 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734347 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734556 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734641 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734854 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.734940 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.735184 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.735270 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.735497 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.735744 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.736058 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.736146 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.736377 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.736461 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.736690 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.736783 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737002 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737086 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737315 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737400 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737630 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737725 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.737950 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.738034 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.738258 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.738343 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.738563 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.738724 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.738864 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739049 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739181 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739314 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739469 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739611 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739768 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.739865 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740066 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740195 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740349 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740483 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740652 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740784 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.740956 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741102 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741248 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741387 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741540 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741671 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741837 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.741931 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.742146 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.742242 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.742457 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.742545 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.742757 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.742854 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.743079 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.743170 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.743381 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.743468 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.743679 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.743772 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.744354 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.744466 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.744466 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.744636 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.744742 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.744903 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745026 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745138 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745330 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745474 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745673 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745780 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.745978 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.746114 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.746316 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.746442 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.746644 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.746779 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747003 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747106 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747313 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747408 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747618 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747704 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.747941 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748039 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748244 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748330 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748548 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748642 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748849 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.748946 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.749152 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.749240 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.749449 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.749538 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.749746 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.749833 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750049 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750142 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750354 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750439 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750656 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750742 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.750969 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.751057 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.751276 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.751371 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.751572 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.751658 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.751871 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752007 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752172 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752325 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752471 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752613 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752753 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.752887 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753043 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753188 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753346 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753481 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753642 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753783 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.753940 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754083 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754252 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754381 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754523 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754659 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754817 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.754916 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.755148 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.755280 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.755445 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.755579 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.755745 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.755894 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756039 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756171 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756335 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756477 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756636 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756778 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.756945 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.757078 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.757245 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.757381 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.757546 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.757686 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.757843 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.758143 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.758306 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.758438 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.758612 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.758748 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.758917 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.759026 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.759249 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.759347 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.759682 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.759982 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.760324 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.760629 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.760939 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.761241 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.761384 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.761547 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.761685 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.761850 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.761968 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.762151 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.762243 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.762450 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.762538 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.762750 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.762843 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763070 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763160 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763378 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763462 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763682 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763778 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.763982 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764068 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764299 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764385 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764581 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764673 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764880 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.764980 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.765204 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.765301 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.765508 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.765608 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.765812 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.765898 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.766115 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.766200 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.766417 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.766510 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.766740 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.766825 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.767088 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.767177 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.767402 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.767537 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.767705 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.767832 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768022 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768171 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768348 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768488 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768659 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768793 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.768966 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.769109 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.769257 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.769394 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.769564 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.769699 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.769871 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770003 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770175 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770318 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770484 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770621 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770786 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.770932 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.771106 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.771239 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.771417 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.771553 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.771719 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.771854 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772023 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772112 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772325 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772419 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772631 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772727 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.772935 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773023 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773239 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773324 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773544 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773640 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773850 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.773942 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.774154 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.774249 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.774463 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.774571 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.774766 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.774858 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.775646 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.775891 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.776358 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.776534 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.776620 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.776699 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.776786 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.776865 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777001 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777089 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777306 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777392 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777615 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777710 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.777921 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778015 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778228 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778314 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778530 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778614 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778845 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.778980 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.779179 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.779298 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.779485 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.779610 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.779789 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.779917 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.780096 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.780229 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.780398 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.780542 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.780820 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.780906 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.781129 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.781216 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.781437 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.781530 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.781740 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.781863 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782051 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782176 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782355 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782486 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782666 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782795 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.782997 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.783132 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.783302 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.783404 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.783707 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.783792 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784016 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784100 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784323 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784408 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784629 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784716 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.784934 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785020 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785257 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785351 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785564 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785650 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785889 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.785989 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.786190 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.786303 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.786494 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.786615 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.786798 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.786922 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.787155 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.787355 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.787462 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.787666 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.787783 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.787976 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.788203 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.788290 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.788513 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.788599 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.788816 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.788910 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.789210 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.789296 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.789522 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.789605 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.789828 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.789921 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.790144 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.790228 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.790463 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.790556 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.791738 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.791856 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.791941 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792020 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792114 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792195 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792322 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792442 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792648 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792756 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.792964 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.793062 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.793287 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.793426 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.793638 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.793774 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.793942 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.794078 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.794265 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.794422 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.794588 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.794765 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.794909 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.795154 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.795300 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.795434 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.795577 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.795711 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.795933 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796081 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796224 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796358 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796511 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796647 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796781 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.796914 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797053 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797194 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797335 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797474 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797608 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797745 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.797900 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798045 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798188 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798322 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798492 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798628 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798816 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.798982 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.799146 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.799368 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.799514 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.799648 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.799781 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.799927 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.800082 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.800228 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.800397 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.800547 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.800691 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.800825 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801008 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801142 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801320 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801455 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801626 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801770 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.801929 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.802065 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.802234 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.802372 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.802527 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.802659 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.802848 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803005 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803188 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803324 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803491 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803627 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803795 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.803931 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.804097 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.804272 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.804437 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.804574 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.804739 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.804882 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.805057 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.805159 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.805376 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.805462 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.805699 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.805785 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806004 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806111 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806326 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806421 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806637 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806758 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.806958 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.807195 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.807285 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.807515 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.807603 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.807840 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.807940 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.808141 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.808226 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.808455 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.808556 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.808748 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.808845 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809049 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809134 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809361 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809500 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809654 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809752 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.809960 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810048 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810261 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810351 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810562 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810658 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810861 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.810967 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.811214 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.811305 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.811516 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.811605 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.811834 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.811923 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.812140 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.812227 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.812440 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.812535 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.812743 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.812833 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813043 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813130 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813375 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813463 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813674 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813760 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.813991 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.814077 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.814300 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.814387 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.814611 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.814696 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.814923 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.815071 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.815255 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.815341 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.815565 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.815657 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.815871 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816054 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816183 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816273 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816483 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816572 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816793 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.816894 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.817106 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.817316 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.817403 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.817645 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.817734 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.817957 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.818046 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.818270 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.818357 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.818584 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.818681 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.818897 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.819005 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.819239 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.819444 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.819568 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.819775 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.819865 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.820087 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.820178 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.820399 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.820493 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.820710 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.820799 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.821023 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.821116 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.821336 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.821423 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.821648 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.821736 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822003 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822151 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822331 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822453 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822605 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822727 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.822915 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823060 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823260 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823360 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823584 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823673 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823884 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.823990 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.824199 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.824327 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.824513 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.824604 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.824824 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.824911 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.825136 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.825281 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.825448 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.825580 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.825762 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.825919 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.826058 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.826192 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.826370 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.826509 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.826678 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.826822 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827007 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827094 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827309 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827397 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827618 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827719 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.827930 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828017 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828246 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828332 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828553 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828643 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828861 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.828954 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.829168 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.829254 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.829478 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.829686 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.829797 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.829997 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.830129 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.830329 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.830430 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.830652 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.830740 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.830998 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.831089 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.831326 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.831434 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.831642 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.832120 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.832218 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.832434 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.832544 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.832764 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.832872 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.833086 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.833175 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.833391 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.833487 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.833696 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.833784 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834005 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834097 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834313 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834409 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834616 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834704 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.834917 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.835029 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.835249 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.835342 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.835554 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.835784 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.835873 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.836136 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.836237 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.836454 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.836542 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.836754 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.836841 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.837069 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.837165 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.837373 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.837472 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.838226 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.838552 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.838629 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.838860 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.838970 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.839191 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.839281 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.839508 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.839604 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.839819 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.839906 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.840126 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.840212 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.840433 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.840528 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.840745 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.840833 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841052 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841137 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841356 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841450 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841667 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841753 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.841970 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842061 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842271 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842365 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842574 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842661 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842879 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.842983 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.843209 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.843298 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.843508 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.843594 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.843811 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.843897 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.844108 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.844201 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.844410 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.844496 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.844715 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.844808 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845014 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845101 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845315 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845404 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845619 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845707 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.845919 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846015 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846220 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846308 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846519 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846623 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846818 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.846903 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.847142 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.847230 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.847441 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.847537 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.847748 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.847835 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848049 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848135 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848355 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848452 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848660 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848747 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.848964 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849050 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849263 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849358 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849575 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849667 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849875 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.849966 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.850175 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.850263 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.850486 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.850735 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.850830 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.851121 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.851227 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.851433 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.851521 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.851740 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.851826 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.852083 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.852188 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.852395 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.852490 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.852699 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.852924 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.853061 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.853381 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.853473 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.853697 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.853803 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854012 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854122 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854321 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854425 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854634 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854741 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.854959 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855062 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855337 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855463 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855582 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855671 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855893 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.855990 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.856204 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.856297 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.856531 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.856628 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.856838 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.856932 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.857146 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.857233 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.857456 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.857545 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.857763 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.857851 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.858071 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.858156 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.858375 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.858462 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.858680 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.858766 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859009 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859100 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859325 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859437 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859651 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859740 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.859964 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860049 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860266 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860361 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860572 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860680 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860881 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.860992 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.861188 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.861311 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.861500 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.861635 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.861825 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.861942 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.862136 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.862253 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.862437 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.862571 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.862851 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.862957 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.863187 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.863276 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.863504 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.863613 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.863823 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.863909 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.864131 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.864218 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.864449 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.864535 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.864769 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.864856 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865073 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865158 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865391 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865476 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865679 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865781 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.865984 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.866072 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.866315 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.866400 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.866630 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.866740 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.866974 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867063 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867275 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867372 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867579 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867681 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867883 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.867988 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.868190 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.868275 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.868507 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.868599 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.869328 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.869503 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.869975 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870067 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870165 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870248 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870326 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870405 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870547 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870679 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.870855 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871027 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871187 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871352 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871495 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871665 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871801 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.871973 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.872130 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.872299 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.872454 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.872607 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.872758 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.872915 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.873080 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.873222 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.873395 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.873528 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.873714 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.873833 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874027 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874142 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874336 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874466 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874664 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874789 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.874997 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.875114 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.875313 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.875437 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.875621 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.875750 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.875931 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.876066 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.876244 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.876379 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.876558 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.876687 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.876883 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877015 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877206 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877324 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877530 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877639 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877855 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.877942 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.878198 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.878291 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.878507 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.878594 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.878845 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.878937 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.879192 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.879277 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.879505 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.879592 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.879816 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.879914 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.880119 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.880211 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.880401 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 00:54:09.880502 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.880761 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.881104 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.881430 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.881742 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.882050 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.882352 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 00:54:09.882590 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 00:54:09.902845 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_db.sqlalchemy.engines [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:09.905006 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_db.sqlalchemy.engines [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:09.971210 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.context [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4(cell1) {{(pid=100877) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 00:54:09.971680 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.context [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4(cell1) {{(pid=100876) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 00:54:09.975438 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_concurrency.lockutils [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 00:54:09.975847 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 00:54:09.977025 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_concurrency.lockutils [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 00:54:09.977404 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 00:54:09.977840 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_concurrency.lockutils [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 00:54:09.978789 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 00:54:09.980660 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_concurrency.lockutils [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 00:54:09.980952 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 00:54:09.991432 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_db.sqlalchemy.engines [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:09.992686 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_db.sqlalchemy.engines [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:09.995187 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_db.sqlalchemy.engines [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:09.998009 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_db.sqlalchemy.engines [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:10.252965 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_db.sqlalchemy.engines [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:10.255935 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG oslo_db.sqlalchemy.engines [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 00:54:10.597745 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: WARNING keystonemiddleware.auth_token [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 00:54:10.598828 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: WARNING keystonemiddleware.auth_token [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 00:54:10.605135 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: WARNING keystonemiddleware.auth_token [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 00:54:10.607270 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: WARNING keystonemiddleware.auth_token [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 00:54:10.831256 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: WARNING keystonemiddleware.auth_token [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 00:54:10.832721 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: WARNING keystonemiddleware.auth_token [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 00:54:10.836670 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: WARNING keystonemiddleware.auth_token [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 00:54:10.837974 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: WARNING keystonemiddleware.auth_token [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 00:54:10.842120 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db090f69c0 pid: 100876 (default app) Nov 11 00:54:10.843331 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db090f69c0 pid: 100877 (default app) Nov 11 00:54:10.844176 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:54:10.845344 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-9a12e70c-62c2-4e28-8fd1-87e5e50da9d8 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Nov 11 00:54:10.845746 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu Nov 11 00:54:10 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:31.939459 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:31.941309 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 Nov 11 00:55:31.941922 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:32.512872 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-2385099c-5595-48d5-b0b8-c73fab5e84d3 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:32.542590 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-2385099c-5595-48d5-b0b8-c73fab5e84d3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.591619 Nov 11 00:55:32.543460 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Nov 11 00:55:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:55:34.892227 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:34.893140 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-da696930-ff52-4086-a432-f69cd49c6f36 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 11 00:55:34.893548 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:34.973627 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-079bbf2e-8dd2-4d44-b349-c2399922c31f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:34.992793 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 00:55:34.992793 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: warnings.warn(msg) Nov 11 00:55:35.022611 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-079bbf2e-8dd2-4d44-b349-c2399922c31f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.122108 Nov 11 00:55:35.026989 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:34 2021] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:55:35.384449 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-f32c8905-385a-4667-ade8-3c6423fc838b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:35.387521 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 00:55:35.387521 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: warnings.warn(msg) Nov 11 00:55:35.438806 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-f32c8905-385a-4667-ade8-3c6423fc838b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.406653 Nov 11 00:55:35.445558 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Nov 11 00:55:35 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 00:55:37.807413 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-079bbf2e-8dd2-4d44-b349-c2399922c31f admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:37.808470 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-079bbf2e-8dd2-4d44-b349-c2399922c31f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Nov 11 00:55:37.812743 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:37 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:37.935990 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-715648db-a99f-4010-a9e2-7932957838aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "name": "ds512M"}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:37.953523 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 00:55:37.953523 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: warnings.warn(msg) Nov 11 00:55:37.984157 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-715648db-a99f-4010-a9e2-7932957838aa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163781 Nov 11 00:55:37.990638 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:55:37.998375 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-dbf74340-5f03-473f-9408-3cdf689e43f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:38.000007 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 00:55:38.000007 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: warnings.warn(msg) Nov 11 00:55:38.034539 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-dbf74340-5f03-473f-9408-3cdf689e43f6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039873 Nov 11 00:55:38.046975 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Nov 11 00:55:37 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:55:40.432994 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-715648db-a99f-4010-a9e2-7932957838aa admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:40.434224 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-715648db-a99f-4010-a9e2-7932957838aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Nov 11 00:55:40.435140 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:40.498700 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8b0def5a-481e-43f3-8cf8-fe280de24758 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:40.518506 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8b0def5a-481e-43f3-8cf8-fe280de24758 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076191 Nov 11 00:55:40.519481 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:55:40.532895 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-2f2d95d5-19d9-4bed-bb19-4e535073c8e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:40.557457 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-2f2d95d5-19d9-4bed-bb19-4e535073c8e7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028236 Nov 11 00:55:40.558235 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Nov 11 00:55:40 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:55:42.941140 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8b0def5a-481e-43f3-8cf8-fe280de24758 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:42.942184 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8b0def5a-481e-43f3-8cf8-fe280de24758 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Nov 11 00:55:42.942586 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:43.001872 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-ac6b1dcf-56b7-4044-b1c2-b9b5d3dde2ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:43.020242 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-ac6b1dcf-56b7-4044-b1c2-b9b5d3dde2ef admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071213 Nov 11 00:55:43.020892 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:55:43.033262 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-eb8d58bf-bb06-4a5b-b924-93328779bff8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:43.055559 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-eb8d58bf-bb06-4a5b-b924-93328779bff8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025977 Nov 11 00:55:43.056307 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Nov 11 00:55:43 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:55:45.413220 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-ac6b1dcf-56b7-4044-b1c2-b9b5d3dde2ef admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:45.414228 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-ac6b1dcf-56b7-4044-b1c2-b9b5d3dde2ef admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 11 00:55:45.414980 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:45.480112 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-b0efeb5c-d10e-49da-8585-8f61b5b5178b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:45.501143 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-b0efeb5c-d10e-49da-8585-8f61b5b5178b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079135 Nov 11 00:55:45.501809 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:55:45.515586 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-42575415-cc36-4559-aaee-09128b94f43a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:45.544442 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-42575415-cc36-4559-aaee-09128b94f43a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033748 Nov 11 00:55:45.545562 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1335 bytes} [Thu Nov 11 00:55:45 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 00:55:47.987191 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-b0efeb5c-d10e-49da-8585-8f61b5b5178b admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:47.988519 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-b0efeb5c-d10e-49da-8585-8f61b5b5178b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Nov 11 00:55:47.988908 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:48.051833 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-d5746809-bc62-49ab-ab51-7dcf65cd5383 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:48.076192 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-d5746809-bc62-49ab-ab51-7dcf65cd5383 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078439 Nov 11 00:55:48.076705 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Nov 11 00:55:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:55:50.397963 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-b0efeb5c-d10e-49da-8585-8f61b5b5178b admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:50.399590 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-b0efeb5c-d10e-49da-8585-8f61b5b5178b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002491 Nov 11 00:55:50.400225 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:50 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:50.462906 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-0ed15d73-6afc-4845-b274-da0ca8243b7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "swap": 0}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:50.487434 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-0ed15d73-6afc-4845-b274-da0ca8243b7e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080416 Nov 11 00:55:50.488290 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:50 2021] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:55:50.503173 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-e7006d24-3a11-45bf-9036-82251889e881 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:50.536102 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-e7006d24-3a11-45bf-9036-82251889e881 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038390 Nov 11 00:55:50.537184 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Nov 11 00:55:50 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:55:52.957550 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-0ed15d73-6afc-4845-b274-da0ca8243b7e admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:52.958687 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-0ed15d73-6afc-4845-b274-da0ca8243b7e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Nov 11 00:55:52.959320 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:53.020001 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-ac8f7e3d-1df5-46a9-bf04-0682ad5d9c80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "ram": 2048, "swap": 0, "vcpus": 1, "id": "2"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:53.038791 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-ac8f7e3d-1df5-46a9-bf04-0682ad5d9c80 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072099 Nov 11 00:55:53.039310 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:55:53.051442 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-ae4e9e1a-0f74-444b-8ed5-be97d63c6e95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:53.073864 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-ae4e9e1a-0f74-444b-8ed5-be97d63c6e95 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025971 Nov 11 00:55:53.074428 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Nov 11 00:55:53 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 00:55:55.370221 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-ac8f7e3d-1df5-46a9-bf04-0682ad5d9c80 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:55.371245 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-ac8f7e3d-1df5-46a9-bf04-0682ad5d9c80 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 11 00:55:55.371648 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:55.430794 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-96710122-3623-43da-baca-75935c589b67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "rxtx_factor": 1.0}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:55.448335 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-96710122-3623-43da-baca-75935c589b67 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070306 Nov 11 00:55:55.449049 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:55:55.462310 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-06af2810-069c-486c-9f4b-44855c2c164a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:55.485793 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-06af2810-069c-486c-9f4b-44855c2c164a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028199 Nov 11 00:55:55.486539 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Nov 11 00:55:55 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 00:55:57.827679 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-96710122-3623-43da-baca-75935c589b67 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:55:57.828682 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-96710122-3623-43da-baca-75935c589b67 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 11 00:55:57.829085 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:55:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:55:57.893526 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-156a2da4-4269-4084-b99b-5b779a6aec80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "swap": 0}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:57.922972 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-156a2da4-4269-4084-b99b-5b779a6aec80 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085188 Nov 11 00:55:57.923525 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:55:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:55:57.937065 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-289c43ee-5c3d-4e78-873b-ed759b8da13b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:55:57.961624 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-289c43ee-5c3d-4e78-873b-ed759b8da13b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028389 Nov 11 00:55:57.962192 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Nov 11 00:55:57 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:56:00.318033 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-156a2da4-4269-4084-b99b-5b779a6aec80 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:00.319126 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-156a2da4-4269-4084-b99b-5b779a6aec80 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001799 Nov 11 00:56:00.324835 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:56:00 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:00.382452 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-c0bea788-f855-4e66-8eee-08aaa696924c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "ram": 16384}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:56:00.401672 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-c0bea788-f855-4e66-8eee-08aaa696924c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075651 Nov 11 00:56:00.402892 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1282 bytes} [Thu Nov 11 00:56:00 2021] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:56:00.415475 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-6f27a477-8a8d-40ee-8a57-8f0a54de9c75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:56:00.441026 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-6f27a477-8a8d-40ee-8a57-8f0a54de9c75 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029157 Nov 11 00:56:00.441613 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1332 bytes} [Thu Nov 11 00:56:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 00:56:39.241214 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-c0bea788-f855-4e66-8eee-08aaa696924c admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:39.242215 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-c0bea788-f855-4e66-8eee-08aaa696924c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Nov 11 00:56:39.242605 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:56:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:39.300841 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-aa4bae28-419a-4563-8cb7-e4d8f7321741 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:39.317752 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-aa4bae28-419a-4563-8cb7-e4d8f7321741 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067073 Nov 11 00:56:39.318275 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Nov 11 00:56:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:40.865013 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-c0bea788-f855-4e66-8eee-08aaa696924c admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:40.866006 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-c0bea788-f855-4e66-8eee-08aaa696924c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 11 00:56:40.866402 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:41.060123 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-74773400-5e93-410b-a94a-b5da64386a05 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:41.065539 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.wsgi [None req-74773400-5e93-410b-a94a-b5da64386a05 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 11 00:56:41.066042 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-74773400-5e93-410b-a94a-b5da64386a05 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 00:56:41.066825 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-74773400-5e93-410b-a94a-b5da64386a05 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059372 Nov 11 00:56:41.067573 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Nov 11 00:56:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 00:56:41.077176 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-abaa9340-cc68-4474-aea2-292eab42922f admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:41.099031 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-abaa9340-cc68-4474-aea2-292eab42922f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024261 Nov 11 00:56:41.099757 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Nov 11 00:56:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:41.109930 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-2deccf7c-8b37-474d-95a0-797c6b7df9b0 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:41.131929 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-2deccf7c-8b37-474d-95a0-797c6b7df9b0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025487 Nov 11 00:56:41.132461 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Nov 11 00:56:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:41.142649 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-4e0cf54b-b11c-419b-a262-27b3c4065f1f admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:41.148712 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.wsgi [None req-4e0cf54b-b11c-419b-a262-27b3c4065f1f admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 11 00:56:41.149272 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-4e0cf54b-b11c-419b-a262-27b3c4065f1f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 00:56:41.150050 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-4e0cf54b-b11c-419b-a262-27b3c4065f1f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011451 Nov 11 00:56:41.150532 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Nov 11 00:56:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 00:56:42.600125 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-2deccf7c-8b37-474d-95a0-797c6b7df9b0 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:42.601112 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-2deccf7c-8b37-474d-95a0-797c6b7df9b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Nov 11 00:56:42.601502 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 00:56:42.791566 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-d4b02953-93e4-4065-a2db-377fa0136e06 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:42.798830 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.wsgi [None req-d4b02953-93e4-4065-a2db-377fa0136e06 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 11 00:56:42.799418 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-d4b02953-93e4-4065-a2db-377fa0136e06 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 00:56:42.800191 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-d4b02953-93e4-4065-a2db-377fa0136e06 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059134 Nov 11 00:56:42.800683 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Nov 11 00:56:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 00:56:42.810876 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-485b2949-cd14-43e1-9697-625b5c3ff28f admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:42.824796 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-485b2949-cd14-43e1-9697-625b5c3ff28f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017431 Nov 11 00:56:42.825311 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Nov 11 00:56:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:42.835509 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-476b2771-dfd2-40d9-ab26-a6d04a824f2c admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:42.848872 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-476b2771-dfd2-40d9-ab26-a6d04a824f2c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017115 Nov 11 00:56:42.849413 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Nov 11 00:56:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:42.858970 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-847ebe85-4b47-4ef4-983c-7aac07334cc6 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:42.864559 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.wsgi [None req-847ebe85-4b47-4ef4-983c-7aac07334cc6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 11 00:56:42.865117 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-847ebe85-4b47-4ef4-983c-7aac07334cc6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 00:56:42.865890 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-847ebe85-4b47-4ef4-983c-7aac07334cc6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010375 Nov 11 00:56:42.866373 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu Nov 11 00:56:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 00:56:44.293824 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-476b2771-dfd2-40d9-ab26-a6d04a824f2c admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:44.294813 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-476b2771-dfd2-40d9-ab26-a6d04a824f2c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Nov 11 00:56:44.295236 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:44.492355 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-0a2de912-8c8b-4bc8-a9c9-42ba07b9b972 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:44.497418 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.wsgi [None req-0a2de912-8c8b-4bc8-a9c9-42ba07b9b972 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 11 00:56:44.497972 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-0a2de912-8c8b-4bc8-a9c9-42ba07b9b972 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 00:56:44.498740 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-0a2de912-8c8b-4bc8-a9c9-42ba07b9b972 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058029 Nov 11 00:56:44.499262 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Nov 11 00:56:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 00:56:44.509162 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-aee65419-21aa-44a8-b76a-edcd3f82a2f3 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:44.522440 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-aee65419-21aa-44a8-b76a-edcd3f82a2f3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016885 Nov 11 00:56:44.523026 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Nov 11 00:56:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:44.532984 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:44.546139 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016970 Nov 11 00:56:44.546650 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu Nov 11 00:56:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:56:44.556842 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-c6acc5ff-ffc7-484f-aef3-687a3e9751d9 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:44.561802 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.wsgi [None req-c6acc5ff-ffc7-484f-aef3-687a3e9751d9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 11 00:56:44.562350 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-c6acc5ff-ffc7-484f-aef3-687a3e9751d9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 00:56:44.563149 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-c6acc5ff-ffc7-484f-aef3-687a3e9751d9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009749 Nov 11 00:56:44.563624 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Nov 11 00:56:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 00:56:45.977415 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:45.978444 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 11 00:56:45.978839 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:46.175950 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-3095c5e9-0fab-4499-a8a2-1bab13316bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:56:46.193817 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-3095c5e9-0fab-4499-a8a2-1bab13316bab admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069476 Nov 11 00:56:46.194276 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Nov 11 00:56:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 00:56:47.614531 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:47.615679 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Nov 11 00:56:47.616128 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:47.807961 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b7f32d5c-e6a1-46b8-8ac6-b9f6befa759d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:56:47.825544 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b7f32d5c-e6a1-46b8-8ac6-b9f6befa759d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068752 Nov 11 00:56:47.826009 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Nov 11 00:56:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:56:49.247971 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:49.248959 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Nov 11 00:56:49.249345 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 00:56:49.437519 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b7e5a318-80ce-43fd-9319-ba3a36e909fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:56:49.455381 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b7e5a318-80ce-43fd-9319-ba3a36e909fe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067875 Nov 11 00:56:49.455839 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Nov 11 00:56:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:56:50.873931 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:50.874926 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 11 00:56:50.875341 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:51.065328 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b04b87ba-3d5e-4584-b7ab-630b3f50f453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 00:56:51.082299 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b04b87ba-3d5e-4584-b7ab-630b3f50f453 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067825 Nov 11 00:56:51.083680 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu Nov 11 00:56:51 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 00:56:52.542344 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:52.543372 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 11 00:56:52.543767 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 00:56:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:56:52.747347 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-fb567c8d-acb3-4d51-b8f1-d57cc3a11494 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:56:52.770643 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-fb567c8d-acb3-4d51-b8f1-d57cc3a11494 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084501 Nov 11 00:56:52.771526 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu Nov 11 00:56:52 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 00:57:39.390111 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:57:39.391169 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8ce83d94-1a29-40e8-af98-b1c3408a4510 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 11 00:57:39.391567 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 930 bytes} [Thu Nov 11 00:57:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 00:57:39.449698 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-3742ae42-cf11-42fb-a98e-71cb95ffd2db admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:57:39.468470 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-3742ae42-cf11-42fb-a98e-71cb95ffd2db admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068867 Nov 11 00:57:39.468984 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1291 bytes} [Thu Nov 11 00:57:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 00:57:39.491931 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-8a143587-60bf-4eab-8daf-753455aa5681 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:57:39.499496 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-8a143587-60bf-4eab-8daf-753455aa5681 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011657 Nov 11 00:57:39.500011 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Nov 11 00:57:39 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:57:39.511651 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-d3da632a-886d-479d-a69a-bdaa12a87e48 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:57:39.518993 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-d3da632a-886d-479d-a69a-bdaa12a87e48 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010712 Nov 11 00:57:39.519495 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Nov 11 00:57:39 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:57:39.532092 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-838a597d-c4c5-42a2-8e32-79167d74857e admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:57:39.540451 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-838a597d-c4c5-42a2-8e32-79167d74857e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011681 Nov 11 00:57:39.540961 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1285 bytes} [Thu Nov 11 00:57:39 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 00:57:39.552259 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:57:39.559477 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010545 Nov 11 00:57:39.559970 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1282 bytes} [Thu Nov 11 00:57:39 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 00:59:02.758655 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-b2c160e5-37bc-4a1f-ab64-5d2c725f4705 tempest-verify_tempest_config-357200980 tempest-verify_tempest_config-357200980-project] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 00:59:02.760694 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-b2c160e5-37bc-4a1f-ab64-5d2c725f4705 tempest-verify_tempest_config-357200980 tempest-verify_tempest_config-357200980-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113113 Nov 11 00:59:02.761221 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 35/69] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Nov 11 00:59:02 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:00:38.857559 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:38.858617 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 11 01:00:38.859038 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 35/70] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 01:00:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:00:39.119257 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-e5391e96-831f-4cd3-8ddd-1fc87d203e29 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:39.120414 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:00:39.120414 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: warnings.warn(msg) Nov 11 01:00:39.121946 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e5391e96-831f-4cd3-8ddd-1fc87d203e29 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:39.122387 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e5391e96-831f-4cd3-8ddd-1fc87d203e29 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:39.123216 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e5391e96-831f-4cd3-8ddd-1fc87d203e29 admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:39.123642 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e5391e96-831f-4cd3-8ddd-1fc87d203e29 admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:39.157032 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-e5391e96-831f-4cd3-8ddd-1fc87d203e29 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150187 Nov 11 01:00:39.157575 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 36/71] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Nov 11 01:00:39 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:00:40.613148 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:40.614144 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Nov 11 01:00:40.614540 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 36/72] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 01:00:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:00:40.810058 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-e4d1734d-f40c-4610-8855-d8b57d1773bd admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:40.811245 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:00:40.811245 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: warnings.warn(msg) Nov 11 01:00:40.812799 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e4d1734d-f40c-4610-8855-d8b57d1773bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:40.813274 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e4d1734d-f40c-4610-8855-d8b57d1773bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:40.814103 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e4d1734d-f40c-4610-8855-d8b57d1773bd admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:40.814533 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-e4d1734d-f40c-4610-8855-d8b57d1773bd admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:40.833243 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-e4d1734d-f40c-4610-8855-d8b57d1773bd admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074648 Nov 11 01:00:40.833722 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 37/73] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Nov 11 01:00:40 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:00:52.716571 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:52.717577 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 11 01:00:52.717978 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 37/74] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 01:00:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:00:52.909894 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-a20385ff-6efc-42bc-b9b0-a39ca2305a8f admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:52.911064 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:00:52.911064 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: warnings.warn(msg) Nov 11 01:00:52.912566 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-a20385ff-6efc-42bc-b9b0-a39ca2305a8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:52.912999 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-a20385ff-6efc-42bc-b9b0-a39ca2305a8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:52.913779 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-a20385ff-6efc-42bc-b9b0-a39ca2305a8f admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:52.914194 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-a20385ff-6efc-42bc-b9b0-a39ca2305a8f admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:52.938217 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-a20385ff-6efc-42bc-b9b0-a39ca2305a8f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078946 Nov 11 01:00:52.938758 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 38/75] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Nov 11 01:00:52 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:00:54.386448 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: DEBUG nova.api.openstack.wsgi [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] Calling method '>' {{(pid=100877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:54.387473 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: INFO nova.api.openstack.requestlog [None req-b16008af-ba0e-4a94-a54f-f3a86d962308 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 11 01:00:54.387870 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: [pid: 100877|app: 0|req: 38/76] 10.222.0.52 () {56 vars in 1074 bytes} [Thu Nov 11 01:00:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:00:54.577640 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG nova.api.openstack.wsgi [None req-1c412e06-1cb0-4297-ab6d-ba327e106f16 admin admin] Calling method '>' {{(pid=100876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:00:54.578780 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:00:54.578780 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: warnings.warn(msg) Nov 11 01:00:54.580453 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-1c412e06-1cb0-4297-ab6d-ba327e106f16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:54.580887 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-1c412e06-1cb0-4297-ab6d-ba327e106f16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:54.581670 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-1c412e06-1cb0-4297-ab6d-ba327e106f16 admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:00:54.582087 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: DEBUG oslo_concurrency.lockutils [None req-1c412e06-1cb0-4297-ab6d-ba327e106f16 admin admin] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:00:54.603035 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: INFO nova.api.openstack.requestlog [None req-1c412e06-1cb0-4297-ab6d-ba327e106f16 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076310 Nov 11 01:00:54.603488 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: [pid: 100876|app: 0|req: 39/77] 10.222.0.52 () {60 vars in 1193 bytes} [Thu Nov 11 01:00:54 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:01:53.265397 dv-cinder-817085-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 11 01:01:53.265946 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: Thu Nov 11 01:01:53 2021 - graceful shutdown triggered... Nov 11 01:01:53.266447 dv-cinder-817085-3-iscsi devstack@n-api.service[100876]: Gracefully killing worker 1 (pid: 100876)... Nov 11 01:01:53.266809 dv-cinder-817085-3-iscsi devstack@n-api.service[100877]: Gracefully killing worker 2 (pid: 100877)... Nov 11 01:01:54.267163 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: worker 1 buried after 1 seconds Nov 11 01:01:54.267163 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: worker 2 buried after 1 seconds Nov 11 01:01:54.267163 dv-cinder-817085-3-iscsi devstack@n-api.service[100875]: goodbye to uWSGI. Nov 11 01:01:54.268636 dv-cinder-817085-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 11 01:01:54.269186 dv-cinder-817085-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 11 01:01:54.272768 dv-cinder-817085-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 11 01:01:54.282157 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 11 01:01:54 2021] *** Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: nodename: dv-cinder-817085-3-iscsi Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: machine: x86_64 Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: clock source: unix Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: pcre jit disabled Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: detected number of CPU cores: 4 Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: current working directory: / Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: detected binary path: /usr/bin/uwsgi-core Nov 11 01:01:54.284168 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: your processes number limit is 47680 Nov 11 01:01:54.284928 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: your memory page size is 4096 bytes Nov 11 01:01:54.284928 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: detected max file descriptor number: 2048 Nov 11 01:01:54.284928 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: lock engine: pthread robust mutexes Nov 11 01:01:54.284928 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: thunder lock: enabled Nov 11 01:01:54.284928 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 11 01:01:54.284928 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 11 01:01:54.331700 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: Python main interpreter initialized at 0x563b26fbb9c0 Nov 11 01:01:54.331700 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: python threads support enabled Nov 11 01:01:54.331700 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: your server socket listen backlog is limited to 100 connections Nov 11 01:01:54.331700 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: your mercy for graceful operations on workers is 90 seconds Nov 11 01:01:54.332159 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: mapped 403077 bytes (393 KB) for 2 cores Nov 11 01:01:54.332159 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: *** Operational MODE: preforking *** Nov 11 01:01:54.332433 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: *** uWSGI is running in multiple interpreter mode *** Nov 11 01:01:54.332433 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: spawned uWSGI master process (pid: 115995) Nov 11 01:01:54.332634 dv-cinder-817085-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 11 01:01:54.333262 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: spawned uWSGI worker 1 (pid: 116015, cores: 1) Nov 11 01:01:54.334369 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: spawned uWSGI worker 2 (pid: 116016, cores: 1) Nov 11 01:01:54.334369 dv-cinder-817085-3-iscsi devstack@n-api.service[115995]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 11 01:01:56.151847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 01:01:56.151847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: from cryptography.utils import int_from_bytes Nov 11 01:01:56.152494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 01:01:56.152494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: from cryptography.utils import int_from_bytes Nov 11 01:01:56.184363 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 01:01:56.184363 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: from cryptography.utils import int_from_bytes Nov 11 01:01:56.184897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 01:01:56.184897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: from cryptography.utils import int_from_bytes Nov 11 01:01:58.506422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 01:01:58.506995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 01:01:58.507201 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 01:01:58.507562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 01:01:58.507819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 01:01:58.508199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.508523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.508844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.509162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.509490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.509799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.510118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.510437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.510763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.511048 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.511363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.511689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-3-iscsi {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.512008 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.512315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.512626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.512943 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.513249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.513573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.513879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.517915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.517915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.517915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.517915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.517915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.517915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-3-iscsi {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.518872 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.519394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.519625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.519941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.520373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.520580 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.521049 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.521304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.521626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.521961 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.522271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.522605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.522895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.523233 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.523545 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.523864 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.524169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.524476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.524730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.525040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.525360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.525685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.526006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.526259 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.526514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.526832 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.527178 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.527491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.527801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.528109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.528418 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.528725 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.529035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.529343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.529651 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.529969 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.530285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.530606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.530915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.531260 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.531658 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.531910 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.532221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.532560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.532879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.533189 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.533507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.533828 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.534140 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.534464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.534759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.535105 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.535443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.535756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.536011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.536316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.537141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.537539 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.537857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.538170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.538481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.538784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.539124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.539441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.539751 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.540060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.540373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.540681 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.540990 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.541291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.541604 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.541923 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.542240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.542553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.543008 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.543201 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.543489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.543811 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.544122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.544429 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.544754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.545063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.545370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.545688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.545997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.546311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.546628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.546927 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.547426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.547746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.547920 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 01:01:58.548398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 01:01:58.548551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.548551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.548848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 01:01:58.548998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.549185 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 01:01:58.549337 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.549503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 01:01:58.549650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.549650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.549936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.550090 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.550242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.550392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.550536 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.550702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.550858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.551070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.551219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.551364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.551551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.551885 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.552730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.552890 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.553036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.553192 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.553351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.553503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.553655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.553808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.553961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.554106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.554272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817085-3-iscsi {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.554428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.554573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.554724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.554869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.555066 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.555218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.555368 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.555512 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.555656 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.555800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.556012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.556160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.556316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.556468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.556619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.556619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.556913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.557083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.557257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.557485 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.557642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.557801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.557954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.558109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.558259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.558404 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.558547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.558702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.558846 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.559009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.559158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.559311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.559465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.559618 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.559768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.559930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.560074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.560228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.560385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817085-3-iscsi {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.560630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.560790 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.560941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.561096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.561249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.561401 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.561553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.561553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.561991 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.562174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.562421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.562584 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.562730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.562873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.563038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.563195 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.563357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.563502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.563647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.563790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.563939 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.564092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.564248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.564401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.564553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.564705 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.564848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.565006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.565158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.565302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.565456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.565600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.565745 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.565897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.566054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.566198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.566349 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.566499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.566651 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.566814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.567019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.567171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.567315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.567491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.568287 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.568495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.568654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.568837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.569029 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.569188 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.569346 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.569493 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.569636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.569792 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.570001 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.570157 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.570309 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.570461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.570606 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.570781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.570935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.571120 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.571267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.571410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.571561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.571704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.571849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.572160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.572313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.572558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.572718 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.572883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.572883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.573182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.573336 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.573488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.573638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.573797 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.573950 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.574104 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.574247 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.574391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.574691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.574858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.575085 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.575257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.575403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.575547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.575698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.575851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.576017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.576164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.576308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.576459 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.576610 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.576754 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.576907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.577068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.577221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.577372 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.577523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.577693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.577918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.578074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.578220 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.578364 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.578507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.578665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.578817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.578989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.579275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.579449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.579606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.579761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.579906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.580063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.580217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.580370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.580529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.580686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.580851 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.580851 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.581143 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.581294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.581440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.581583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.581740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.581884 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.582035 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.582340 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.582492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.582735 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.582901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.583124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.583283 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.584095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.584310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.584474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.584630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.584775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.584917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.585061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.585212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.585212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.585498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.585650 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.585812 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.585812 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.586677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.586677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.586987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.586987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.587280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.587431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.587590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.587742 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.587913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.588387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.588548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.588701 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.588855 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.589019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.589164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.589318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.589462 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.589613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.589759 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.589913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.590058 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.590214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.590358 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.590510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.590654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.590817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.591018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.591284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.591450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.591597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.591740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.591886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.592043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.592195 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.592502 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.592653 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.592913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.593073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.593240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.593392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.593537 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.593689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.593843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.593995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.594149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.594302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.594453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.594605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.594755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.594906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.595092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.595248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.595393 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.595537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.595687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.595842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.595993 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.596152 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.596298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.596449 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.596594 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.596751 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.596903 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.597047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.597202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.597353 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.597499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 01:01:58.597653 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.597653 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.597935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.598080 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.598318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.598474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.598629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.598780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.598925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.599206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.599583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.599757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.599905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.600064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.600216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.600376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.600528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.600700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.600857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601177 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601329 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601820 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.601971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.602121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.602270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.602587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.602749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.602749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.603224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.603381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.603540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.603707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.603885 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604194 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.604972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.605295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.605455 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.605614 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.605776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.605929 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.606091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.606242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.606404 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.606404 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.606701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.606853 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.607984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.608135 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.608303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.608543 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.608701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.608859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609648 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.609799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.610095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.610246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.610404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.610563 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.610733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.610896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.611071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.611280 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.611443 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.611602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.611760 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.611913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.612062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.612233 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.612393 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.612562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.612874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.613027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.613178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.613445 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.613611 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.613763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.613915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.614073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.614225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.614389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.614567 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.614798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615003 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615003 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615477 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.615943 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.616095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.616255 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.616406 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.616577 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.616741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.616893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.617090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.617265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.617425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.617590 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.617750 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.617908 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.618066 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.618231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.618389 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.618569 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.618804 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.618980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.619226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.619381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.619531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.619689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.619689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.619989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.620154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.620313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.620471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.620629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.620790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.620953 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.621113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.621265 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.621415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.621415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.621699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.621856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.622017 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.622181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.622333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.622496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.622655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.622967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.623151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.623304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.623479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.623756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.623914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.624070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.624220 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.624378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.624528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.624688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.624848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.625006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.625169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.625321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.625558 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.625718 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.625869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626643 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.626978 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.627145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.627309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.627472 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.627624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.627780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.627938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.628095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.628252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.628416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.628575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.628726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.628959 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.629123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.629288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.629457 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.629616 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.629774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.629932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.630090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.630801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631811 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.631962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.632125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.632275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.632425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.634785 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.635132 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.635299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.635629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.635803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.635974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.636141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.636301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.636459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.636631 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.636782 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.638463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.638636 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.638800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.638985 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.639371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.639541 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.639702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.639870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.640994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.641154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.641154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.641154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.641598 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.641751 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.641902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.642058 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.642210 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.642368 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.642540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.642692 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.642843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.643230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.643402 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.643562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.643722 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644214 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644368 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644669 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.644993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645144 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645618 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.645770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.646870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.646870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.646870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.647418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.647577 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.647741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.647893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648044 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.648963 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.649123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.649402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.649561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.649724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.649874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.650031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.650196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.650348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.650505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.650656 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.650812 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651510 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.651984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.652136 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.652286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.652436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.652815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.652977 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.653162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.653492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.653652 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.653806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.653963 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.654222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.654403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.654595 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.654757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.654917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.655092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.655261 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.655420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.655571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.655721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.655878 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.656036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.656201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.656359 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.656527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.656679 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.656869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657184 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657184 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657777 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.657935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.658099 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.658251 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.658401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.658569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.658721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.658883 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.659062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.659213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.659381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.659605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.659760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.659928 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.660081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.660081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.660373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.660535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.660693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.660867 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.661019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.661178 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.661330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.661516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.661760 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.661994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.662287 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.662452 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.662612 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.662764 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.662935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.663228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.663564 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.663731 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.663891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.664044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.664223 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.664471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.664628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.664786 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.664945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.665103 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.665264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.665436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.665588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.665753 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.665914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.666072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.666236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.666395 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.666546 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.666703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.666854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667033 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667033 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.667977 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.668128 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.668278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.668438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.668596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.668755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.668914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.669066 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.669216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.669383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.669535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.669784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.669987 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.670144 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.670303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.670455 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.670607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.670771 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.670956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.671115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.671266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.671416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.671590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.671757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.671916 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.672068 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.672225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.672376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.672532 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.672697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.672856 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.673007 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.673166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.673166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.673470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.673796 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.673962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.674121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.674279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.674681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.674681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.675059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.675218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.675370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.675537 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.675689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.675849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676180 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676643 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676794 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.676943 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.677133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.677299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.677452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.677609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.677951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.678109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.678109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.678426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.678663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.678821 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.679022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.679212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.679467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.679653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.679899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.680058 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.680209 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.680359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.680510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.680686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.680845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681482 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.681951 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.682111 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.682262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.682426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.682588 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.682746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.682898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.683084 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.683245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.683405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.683556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.683732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.684053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.684208 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.684359 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.684520 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.684672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685016 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685179 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.685940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.686090 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.686253 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.686413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.686563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.686714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.686869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.687100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.687256 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.687422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.687574 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.687724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.687881 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688197 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688679 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688837 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.688994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.689164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.689315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.689473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.689630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.689781 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.690975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.691306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.691584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.691755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.691908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.692059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.692216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.692435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.692590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.693266 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.693421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.693572 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.693736 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.693914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.694233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.694385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.694543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.694704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.694864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.695162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.695329 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.695482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.695640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.695799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.695964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.696116 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.696266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.696435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.696586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.696799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.696963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.697114 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.697272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.697425 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.697583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.697744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.697896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.698053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.698204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.698354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.698515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.698680 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.698840 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.699022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.699186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.699338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.699487 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.699721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.699892 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.700131 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.700289 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.700451 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.700609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.700785 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.700938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.701096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.701248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.701398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.701571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.701724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.701884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702260 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702623 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702880 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.702998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703233 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703354 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703466 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.703918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704051 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704435 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704557 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.704899 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705479 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705699 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705817 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.705941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706164 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706502 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.706980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707592 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.707941 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.708052 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.708174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.708332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709794 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.709953 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.710230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.710391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.710550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.710709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.710868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.711085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.711251 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.711411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.711576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.711742 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.711901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.712053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.712217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.712379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.712533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.712690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.712848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.713009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.713417 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.713573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.713734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.713895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.714054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.714445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.714621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.714776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.714934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.715122 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.715274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.715274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.715274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.715274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.715274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.716098 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.716259 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.716419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.716571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.716729 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.716880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.717946 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.718120 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.718120 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.718415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.718565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.718723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.718888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.719066 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.719229 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.719388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.719546 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.719697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.719857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.720024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.720201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.720432 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.720589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.720786 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.720957 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.721118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.721276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.721428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.721587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.721746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.721910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.722062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.722224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.722383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.722534 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.722698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.722849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723816 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.723991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.724157 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.724320 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.724709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.724880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.725042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.725194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.725343 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.725494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.725645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.725907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.726065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.726218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.726368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.726538 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.726700 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.726860 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.727063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.727231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.727383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.727534 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.727697 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.727849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728006 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728157 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.728982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.729133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.729290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.729454 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.729619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.729770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.729920 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.730071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.730222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.730382 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.730630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.730797 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.730964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.731131 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.731407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.731603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.731760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.731911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.732061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.732211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.732362 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.732525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.732685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.732836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733005 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733520 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733676 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.733977 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.734127 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.734297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.734456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.734773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.734940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.735149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.735301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.735461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.735653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.735805 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.736068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.736226 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.736385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.736550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.736710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.736861 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737807 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.737965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.738117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.738289 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.738449 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.738603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.738754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.738905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.739090 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.739257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.739420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.739595 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.739595 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.739595 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.740031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.740236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.740236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.740523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.740762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.740920 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.741082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.741235 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.741386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.741572 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.741789 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.741947 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.742113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.742267 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.742425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.742634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.742800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.743010 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.743182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.743373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.743530 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.743692 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.743844 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.744004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.744164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.744323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.744475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.744634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.744947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.745120 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.745274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.745433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.745591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.745743 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.745905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.746083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.746331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.746488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.746647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.746798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.746974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.747146 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.747306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.747459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.747611 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.747768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748006 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748320 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748787 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.748952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.749113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.749273 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.749463 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.749619 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.749778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.749945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.750115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.750275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.750426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.750577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.750744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.751025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.751226 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.751409 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.751566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.751723 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.751884 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752035 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.752980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.753138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.753138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.753495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.753649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.753809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.753968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.754119 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.754295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.754448 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.754612 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.754764 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.755077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.755765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.755928 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.756087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.756343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.756586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.756743 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.756894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.757054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.757226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.757392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.757545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.757697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.757848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.758006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.758171 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.758920 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.759104 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.759272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.759272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.759576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.759728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.759879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.760103 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.760271 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.760650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.760813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.760992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.761234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.761413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.761569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.761745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.761916 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.762070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.762222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.762383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.762640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.762808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.763955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.764107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.764268 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.764421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.764572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.764730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.764882 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.765227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.765401 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.765554 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.765706 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.765857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.766105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.766270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.766423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.766591 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.766852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767507 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767817 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.767969 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.768134 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.768298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.768298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.768586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.768745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.768906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.769064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.769227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.769385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.769536 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.769686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.769855 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.770605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.770785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.771585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.771866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.772029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.772182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.772350 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.772510 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.772662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.772824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773273 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773578 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773673 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.773762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.774371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.776739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.777607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.778773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.781747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.782884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.784924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.785660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.786649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.786649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.786649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_db.sqlalchemy.engines [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.787170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.788954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.789570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.789570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.789844 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.790159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.790473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.790790 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.791169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.791496 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.791826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.792218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.792548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.792988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.793353 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.793719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.794049 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.794419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.796940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.797302 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.798857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.799264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.799616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.799964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.800305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.800662 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.801015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.801346 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.801694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.802053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.802559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.802897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.803257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.803606 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.803937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.804275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.804707 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.805163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.805504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.805843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.806186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.806528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.806870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.807251 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.807615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.807946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.808307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.808648 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.808975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.809303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.809620 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 01:01:58.809873 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 01:01:58.832677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_db.sqlalchemy.engines [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:58.941632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.context [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4(cell1) {{(pid=116016) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 01:01:58.946730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:01:58.948407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:01:58.949262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:01:58.951517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:01:58.962798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_db.sqlalchemy.engines [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:58.964241 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_db.sqlalchemy.engines [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:58.999016 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.context [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4(cell1) {{(pid=116015) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 01:01:59.003352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:01:59.004950 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:01:59.006398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:01:59.008566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:01:59.019499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_db.sqlalchemy.engines [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:59.020884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_db.sqlalchemy.engines [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:59.135392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_db.sqlalchemy.engines [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:59.184719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_db.sqlalchemy.engines [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 01:01:59.476288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: WARNING keystonemiddleware.auth_token [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 01:01:59.485095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: WARNING keystonemiddleware.auth_token [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 01:01:59.557542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: WARNING keystonemiddleware.auth_token [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 01:01:59.564996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: WARNING keystonemiddleware.auth_token [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 01:01:59.738493 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: WARNING keystonemiddleware.auth_token [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 01:01:59.745189 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: WARNING keystonemiddleware.auth_token [None req-19e4f15a-c28e-4ddb-9653-049c586fa9fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 01:01:59.750622 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b26fbb9c0 pid: 116016 (default app) Nov 11 01:01:59.830030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: WARNING keystonemiddleware.auth_token [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 01:01:59.836064 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: WARNING keystonemiddleware.auth_token [None req-ba81c447-dfb6-4e56-8954-8950317b4fca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 01:01:59.841677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b26fbb9c0 pid: 116015 (default app) Nov 11 01:02:34.363218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5e1b5f1d-a7d9-43e3-ab1a-c3b8bd6be552 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Action: 'create', calling method: .version_select at 0x7fd365044c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1955963767", "metadata": {"Type": "work"}}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:34.365118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5e1b5f1d-a7d9-43e3-ab1a-c3b8bd6be552 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:34.366077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5e1b5f1d-a7d9-43e3-ab1a-c3b8bd6be552 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.573385 Nov 11 01:02:34.370906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Nov 11 01:02:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1576 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 11 01:02:34.392425 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-24c52e04-6afc-4414-8859-6145e21cd79e tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Action: 'create', calling method: .version_select at 0x7fd364fb1790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-469963092", "metadata": {"Type": "work"}}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:34.404669 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-24c52e04-6afc-4414-8859-6145e21cd79e tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:34.406762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-24c52e04-6afc-4414-8859-6145e21cd79e tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034610 Nov 11 01:02:34.410674 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Nov 11 01:02:34 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 11 01:02:34.418975 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7a83b2e8-9ea6-49c2-b6a6-43eb440c869c tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd365044d30>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:34.461635 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d4c7d236-2069-4f5c-bb94-373a616b28d1 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Action: 'create', calling method: .version_select at 0x7fd365044c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1744190157"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:34.997142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7a83b2e8-9ea6-49c2-b6a6-43eb440c869c tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0a1222b2-d5c5-41d7-a396-db6b942a2fba" status: 200 len: 351 microversion: 2.1 time: 0.585161 Nov 11 01:02:34.997871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 3/3] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:34 2021] GET /compute/v2.1/os-volumes/0a1222b2-d5c5-41d7-a396-db6b942a2fba => generated 351 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:35.007571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0bab7a0e-15dd-4bf2-bbd5-0a192fc65db6 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Action: 'create', calling method: .version_select at 0x7fd364fe1310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-491522810", "metadata": {"Type": "work"}}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:35.008810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0bab7a0e-15dd-4bf2-bbd5-0a192fc65db6 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:35.009613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0bab7a0e-15dd-4bf2-bbd5-0a192fc65db6 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010680 Nov 11 01:02:35.011576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 4/4] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Nov 11 01:02:34 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 11 01:02:35.026549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-de59e684-3cf5-4fa7-a5bf-5635f7769d30 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Calling method '.version_select at 0x7fd3658b3310>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:35.462163 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-de59e684-3cf5-4fa7-a5bf-5635f7769d30 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] HTTP exception thrown: Volume tempest-invalid-97501018 could not be found. Nov 11 01:02:35.462817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-de59e684-3cf5-4fa7-a5bf-5635f7769d30 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Returning 404 to user: Volume tempest-invalid-97501018 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:35.463927 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-de59e684-3cf5-4fa7-a5bf-5635f7769d30 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-97501018" status: 404 len: 97 microversion: 2.1 time: 0.442685 Nov 11 01:02:35.464476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1211 bytes} [Thu Nov 11 01:02:35 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-97501018 => generated 97 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 11 01:02:35.593202 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1437461298", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "232e5fb8-96bd-4e33-ad1f-50b0e7e803d2"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:35.595531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d4c7d236-2069-4f5c-bb94-373a616b28d1 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.111245 Nov 11 01:02:35.596286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 1/6] 10.222.0.52 () {60 vars in 1154 bytes} [Thu Nov 11 01:02:33 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2114 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 11 01:02:35.748907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-701827511", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "048a8821-d983-414f-be92-0b2d1da42155"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:35.776518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] validate_networks() for [('232e5fb8-96bd-4e33-ad1f-50b0e7e803d2', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:02:36.003492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] validate_networks() for [('048a8821-d983-414f-be92-0b2d1da42155', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:02:37.073518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:02:37.074703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:02:37.075577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:02:37.076196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:02:37.076860 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:02:37.093464 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:37.094194 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:37.095283 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:37.096065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:37.118649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:02:37.119311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:02:37.119912 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:02:37.120387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:02:37.121448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:02:37.131633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Getting quotas for project daf7efb5653647a882c13e0316a7ab68. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:37.140168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Getting quotas for user b39efe5377b14c469b09d6c88a3474f5 and project daf7efb5653647a882c13e0316a7ab68. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:37.154145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:37.154602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:37.155567 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:02:37.159513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:37.159830 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:02:37.159975 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:37.214379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:37.222720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for user 325e6f2cc9e0420a8f09d879000375d3 and project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:37.238039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:02:37.243005 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:02:37.318125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-006bd6f4-c3d7-4c96-aacf-7a56ae29a538 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715053 Nov 11 01:02:37.318837 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 2/7] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:02:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:02:37.335557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c0e43557-f6a3-47b9-bdc6-5e878a82d42b tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012505 Nov 11 01:02:37.336160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 3/8] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Nov 11 01:02:37 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 11 01:02:37.343435 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bab26d2a-d88d-4e35-96ab-6772c96b0e82 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd364e38040>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:37.406778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7f35f3ef-961a-4c01-80ef-ef8a5ca1ed47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941231 Nov 11 01:02:37.414345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 6/9] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:02:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:02:37.423234 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b08c090a-289e-4363-8b00-4877dda60255 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd364e3c0d0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:37.495542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bab26d2a-d88d-4e35-96ab-6772c96b0e82 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6" status: 200 len: 346 microversion: 2.1 time: 0.157066 Nov 11 01:02:37.496319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 4/10] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:37 2021] GET /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6 => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:37.507207 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9677ce7c-10e8-4986-a776-3d38507df733 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:37.507865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9677ce7c-10e8-4986-a776-3d38507df733 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:37.532609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b08c090a-289e-4363-8b00-4877dda60255 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73efd0bd-90b0-49b7-b734-6bc4425b3085" status: 200 len: 351 microversion: 2.1 time: 0.113491 Nov 11 01:02:37.534648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 7/11] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:37 2021] GET /compute/v2.1/os-volumes/73efd0bd-90b0-49b7-b734-6bc4425b3085 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:37.556514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a0503e75-96a9-4efb-891a-ac44560520b5 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019591 Nov 11 01:02:37.564567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 8/12] 10.222.0.52 () {58 vars in 1136 bytes} [Thu Nov 11 01:02:37 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 11 01:02:37.573161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7ddde782-2b25-4b45-a637-5ca49ac594f9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:37.598300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7ddde782-2b25-4b45-a637-5ca49ac594f9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:37.756772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9677ce7c-10e8-4986-a776-3d38507df733 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:37.782772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9677ce7c-10e8-4986-a776-3d38507df733 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1214 microversion: 2.1 time: 0.285220 Nov 11 01:02:37.784073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 5/13] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:37 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:37.797512 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-19b13bc2-9768-435f-9b1c-5b754ed23a87 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Action: 'create', calling method: .version_select at 0x7fd3645dbaf0>, body: {"snapshot": {"volume_id": "1e218766-9201-4126-9c98-ecc6c7416ee6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1710747132"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:38.089255 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7ddde782-2b25-4b45-a637-5ca49ac594f9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:38.117481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7ddde782-2b25-4b45-a637-5ca49ac594f9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1218 microversion: 2.1 time: 0.545360 Nov 11 01:02:38.120188 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 9/14] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:37 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1218 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:38.128290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6e068c2d-a07b-4be9-84b5-8259e4e47833 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Calling method '.version_select at 0x7fd364e3ce50>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:38.146375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-19b13bc2-9768-435f-9b1c-5b754ed23a87 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.361063 Nov 11 01:02:38.148391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 6/15] 10.222.0.52 () {60 vars in 1161 bytes} [Thu Nov 11 01:02:37 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:38.161430 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2572905a-f67c-4375-8dae-47d8c23fac4d tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3645ecb80>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:38.197856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-6e068c2d-a07b-4be9-84b5-8259e4e47833 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] HTTP exception thrown: Volume caec1899-2b22-4d03-9891-d72c2146752b could not be found. Nov 11 01:02:38.198507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6e068c2d-a07b-4be9-84b5-8259e4e47833 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Returning 404 to user: Volume caec1899-2b22-4d03-9891-d72c2146752b could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:38.199760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6e068c2d-a07b-4be9-84b5-8259e4e47833 tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/caec1899-2b22-4d03-9891-d72c2146752b" status: 404 len: 109 microversion: 2.1 time: 0.078075 Nov 11 01:02:38.200306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 10/16] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Nov 11 01:02:38 2021] DELETE /compute/v2.1/os-volumes/caec1899-2b22-4d03-9891-d72c2146752b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:38.211091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ad893d60-a3c5-4298-bc1c-0c7b3a1daecd tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Calling method '.version_select at 0x7fd3645f90d0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:38.249243 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2572905a-f67c-4375-8dae-47d8c23fac4d tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 287 microversion: 2.1 time: 0.092968 Nov 11 01:02:38.250312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 7/17] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:38 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:02:38.266556 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-15f9b96d-d4e0-44a7-a423-574245c7c16e tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd364e2aee0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:38.310342 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-ad893d60-a3c5-4298-bc1c-0c7b3a1daecd tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] HTTP exception thrown: Volume fcf33186-40e7-453d-9355-27a905226dab could not be found. Nov 11 01:02:38.312267 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ad893d60-a3c5-4298-bc1c-0c7b3a1daecd tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] Returning 404 to user: Volume fcf33186-40e7-453d-9355-27a905226dab could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:38.313831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ad893d60-a3c5-4298-bc1c-0c7b3a1daecd tempest-VolumesNegativeTest-2019557616 tempest-VolumesNegativeTest-2019557616-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/fcf33186-40e7-453d-9355-27a905226dab" status: 404 len: 109 microversion: 2.1 time: 0.107729 Nov 11 01:02:38.314792 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 11/18] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:38 2021] GET /compute/v2.1/os-volumes/fcf33186-40e7-453d-9355-27a905226dab => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:38.372204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-15f9b96d-d4e0-44a7-a423-574245c7c16e tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113781 Nov 11 01:02:38.373231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 8/19] 10.222.0.52 () {58 vars in 1139 bytes} [Thu Nov 11 01:02:38 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:02:38.387596 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-40a0f7cb-c4b3-4213-a34f-f552f17f2912 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3645cb820>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:38.430643 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-40a0f7cb-c4b3-4213-a34f-f552f17f2912 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 287 microversion: 2.1 time: 0.048029 Nov 11 01:02:38.431255 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 12/20] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:38 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:38.800417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d2295d60-a2a3-4306-b54b-79097f015e51 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:38.801355 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d2295d60-a2a3-4306-b54b-79097f015e51 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:38.957909 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d2295d60-a2a3-4306-b54b-79097f015e51 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:38.978130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d2295d60-a2a3-4306-b54b-79097f015e51 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1214 microversion: 2.1 time: 0.181484 Nov 11 01:02:38.981065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 9/21] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:38 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:39.137783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:39.138464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:39.155674 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:39.156134 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:39.163196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:39.164821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:39.445885 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7cc87cc5-364f-47bc-b6d0-4a5157d6d7d4 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3645f69d0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:39.521204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7cc87cc5-364f-47bc-b6d0-4a5157d6d7d4 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 287 microversion: 2.1 time: 0.083100 Nov 11 01:02:39.522691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 10/22] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:39 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:02:39.749083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:39.771040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d33ae2b5-78e3-4b2e-b912-268e6fe3b1f4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1222 microversion: 2.1 time: 0.634824 Nov 11 01:02:39.772554 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 13/23] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:39 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1222 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:39.996339 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:39.997033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:40.004826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:40.005350 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:40.007759 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:40.008459 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:40.179808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:40.194067 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-40b23ffb-7cac-4da5-9c7d-a18c19de9e8f tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1218 microversion: 2.1 time: 0.201227 Nov 11 01:02:40.194905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 11/24] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:39 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:40.533238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-85460a84-bd4e-46be-8995-5118e76933a4 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd36456d700>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:40.586072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-85460a84-bd4e-46be-8995-5118e76933a4 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 287 microversion: 2.1 time: 0.056558 Nov 11 01:02:40.587091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 14/25] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:40 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:40.789601 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:40.790315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:40.800232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:40.804437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:40.805640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:40.806272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:40.927121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:40.947336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-32c3643d-9e1b-449b-802c-06d2f6642193 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1222 microversion: 2.1 time: 0.150450 Nov 11 01:02:40.948878 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 12/26] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:40 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:41.215757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:41.217190 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:41.250153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:41.252937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:41.254479 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:41.256283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:41.455675 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:41.467878 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-86cd73b7-a50c-4b11-9800-a5f6f74469ae tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1218 microversion: 2.1 time: 0.260105 Nov 11 01:02:41.474214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 15/27] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:41 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:41.609292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e7654c6e-a83c-4533-809f-1bda8e9356f1 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3645ec820>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:41.674726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e7654c6e-a83c-4533-809f-1bda8e9356f1 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 287 microversion: 2.1 time: 0.079427 Nov 11 01:02:41.675267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 13/28] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:41 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:41.966769 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:41.967616 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:41.982202 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:41.983070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:41.986010 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:41.987064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:42.247679 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:42.259541 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-862aa411-ca50-4f23-9204-b4923a9c2b0f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1222 microversion: 2.1 time: 0.297824 Nov 11 01:02:42.272376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 16/29] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:41 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1222 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:42.491251 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:42.492831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:42.534192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:42.544236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:42.545256 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:42.553065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:42.689020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3c5bb0d0-d8e7-4442-ab3a-55a7b5efe3b1 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd3645298b0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:42.756167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:42.764452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dc532992-bafa-4d23-9b83-2215614c4ee5 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1210 microversion: 2.1 time: 0.278668 Nov 11 01:02:42.776089 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 14/30] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:42 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1210 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:42.786710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-85c555f7-e485-4b9a-9cac-c8549994fed3 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd36452b5e0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:42.808057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3c5bb0d0-d8e7-4442-ab3a-55a7b5efe3b1 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d3f60413-c22e-4514-b7bd-7e7c4f47f531" status: 200 len: 350 microversion: 2.1 time: 0.123064 Nov 11 01:02:42.814875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:42 2021] GET /compute/v2.1/os-volumes/d3f60413-c22e-4514-b7bd-7e7c4f47f531 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:42.820542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-98232592-d26f-467e-8fd9-5e22a2d70692 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd364529dc0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:42.927912 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-85c555f7-e485-4b9a-9cac-c8549994fed3 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 288 microversion: 2.1 time: 0.147095 Nov 11 01:02:42.927912 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 15/32] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:42 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 288 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:42.938020 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a0818755-0766-41b6-809c-e611ed714562 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd36455fe50>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.054283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-98232592-d26f-467e-8fd9-5e22a2d70692 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.238054 Nov 11 01:02:43.055937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 18/33] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Nov 11 01:02:42 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:43.071600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-20295781-162b-4751-ae6a-70301ee57e4d tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd3645cb5e0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.165930 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a0818755-0766-41b6-809c-e611ed714562 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 202 len: 0 microversion: 2.1 time: 0.231271 Nov 11 01:02:43.171157 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 16/34] 10.222.0.52 () {58 vars in 1253 bytes} [Thu Nov 11 01:02:42 2021] DELETE /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:02:43.178273 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c4ddfe01-734f-4a48-b55e-3409ddb4606f tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3645723a0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.288284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c4ddfe01-734f-4a48-b55e-3409ddb4606f tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 200 len: 287 microversion: 2.1 time: 0.106539 Nov 11 01:02:43.293637 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 17/35] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:43.309461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.310506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:43.324752 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:43.325260 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:43.327889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:43.331638 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:43.374983 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-20295781-162b-4751-ae6a-70301ee57e4d tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.310148 Nov 11 01:02:43.379645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 19/36] 10.222.0.52 () {58 vars in 1148 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:02:43.406291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4c752b9b-e716-48b8-9230-83e2ea92f5ad tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd364555c10>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.586226 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4c752b9b-e716-48b8-9230-83e2ea92f5ad tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.194565 Nov 11 01:02:43.587602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 20/37] 10.222.0.52 () {58 vars in 1133 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:02:43.604623 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-10f3cbbe-5980-4967-9033-0c82a961ad4e tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd3645308b0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.679068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:43.691019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c08e5bba-a619-46df-9d94-370d79a13106 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1270 microversion: 2.1 time: 0.395747 Nov 11 01:02:43.697752 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 18/38] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1270 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:43.785231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:43.786775 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:43.794471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:43.795310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:43.796361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:43.797003 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:43.903555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:43.912975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4d966752-afd5-4e9b-906d-b0df694af168 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1284 microversion: 2.1 time: 0.131036 Nov 11 01:02:43.928137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-10f3cbbe-5980-4967-9033-0c82a961ad4e tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.332213 Nov 11 01:02:43.930976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 21/39] 10.222.0.52 () {58 vars in 1166 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:43.937410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 19/40] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:43.947317 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-366ea59c-d42f-4829-8a91-197c37db6367 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd364e38700>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:44.221771 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-366ea59c-d42f-4829-8a91-197c37db6367 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.277751 Nov 11 01:02:44.222967 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 20/41] 10.222.0.52 () {58 vars in 1169 bytes} [Thu Nov 11 01:02:43 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:44.239142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6344d567-2ed5-45d4-8035-0c9087dbd91e tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd3645dbc10>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:44.407395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6344d567-2ed5-45d4-8035-0c9087dbd91e tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.171946 Nov 11 01:02:44.411283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-904878862", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288ad7ee-ad49-45cc-b619-30fceacb55ee"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:44.417581 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Nov 11 01:02:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:02:44.422931 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-52172af5-5939-48d4-b183-550d933b026d tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3644d2700>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:44.456607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-52172af5-5939-48d4-b183-550d933b026d tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] HTTP exception thrown: Snapshot 7a14c8ba-6383-47ff-b900-75228b082cf1 could not be found. Nov 11 01:02:44.460508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-52172af5-5939-48d4-b183-550d933b026d tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Returning 404 to user: Snapshot 7a14c8ba-6383-47ff-b900-75228b082cf1 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:44.462282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-52172af5-5939-48d4-b183-550d933b026d tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1" status: 404 len: 111 microversion: 2.1 time: 0.042649 Nov 11 01:02:44.467649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1250 bytes} [Thu Nov 11 01:02:44 2021] GET /compute/v2.1/os-snapshots/7a14c8ba-6383-47ff-b900-75228b082cf1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:44.475417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a62f3e3b-1a34-43ae-88f7-af63f73257c3 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd36455fdc0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:44.572721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] validate_networks() for [('288ad7ee-ad49-45cc-b619-30fceacb55ee', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:02:44.650732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a62f3e3b-1a34-43ae-88f7-af63f73257c3 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.186793 Nov 11 01:02:44.657812 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 23/44] 10.222.0.52 () {58 vars in 1187 bytes} [Thu Nov 11 01:02:44 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:44.657812 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d743d24b-7fd8-42b6-9710-bf3bd156c504 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd36455fd30>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:44.818575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d743d24b-7fd8-42b6-9710-bf3bd156c504 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6" status: 202 len: 0 microversion: 2.1 time: 0.165751 Nov 11 01:02:44.822540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 24/45] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Nov 11 01:02:44 2021] DELETE /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:02:44.825771 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0e1226ab-7e33-40c4-9300-b209de1e0fb2 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] Calling method '.version_select at 0x7fd3658b3430>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:45.075604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0e1226ab-7e33-40c4-9300-b209de1e0fb2 tempest-VolumesTestJSON-61088278 tempest-VolumesTestJSON-61088278-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.254794 Nov 11 01:02:45.076190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 25/46] 10.222.0.52 () {58 vars in 1154 bytes} [Thu Nov 11 01:02:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:45.094829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:45.095709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:45.106877 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:45.111862 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:45.114103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:45.114875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:45.321824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:45.337709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-028d90b1-b801-4931-a119-76f9d3a52e3a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1276 microversion: 2.1 time: 0.260437 Nov 11 01:02:45.340370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 26/47] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:45 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:45.364348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0233e45b-2bba-446c-b4ed-32db87efa03b tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3644c9ee0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:45.444310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-0233e45b-2bba-446c-b4ed-32db87efa03b tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] HTTP exception thrown: Volume 1e218766-9201-4126-9c98-ecc6c7416ee6 could not be found. Nov 11 01:02:45.445272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0233e45b-2bba-446c-b4ed-32db87efa03b tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Returning 404 to user: Volume 1e218766-9201-4126-9c98-ecc6c7416ee6 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:45.446439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0233e45b-2bba-446c-b4ed-32db87efa03b tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6" status: 404 len: 109 microversion: 2.1 time: 0.102467 Nov 11 01:02:45.451734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 27/48] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:45 2021] GET /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:45.456837 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:45.458128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:45.465883 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:45.466554 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:45.467555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:45.468137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:45.657588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:45.667087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2a5ba4d5-992c-4eda-abe0-ed969a3be284 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1272 microversion: 2.1 time: 0.214182 Nov 11 01:02:45.672139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 28/49] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:45 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:45.693592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-188c22ff-15c6-4b7c-8bcb-9096a1e03627 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd3644d1f70>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:45.756604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-188c22ff-15c6-4b7c-8bcb-9096a1e03627 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] HTTP exception thrown: Volume 1e218766-9201-4126-9c98-ecc6c7416ee6 could not be found. Nov 11 01:02:45.758492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-188c22ff-15c6-4b7c-8bcb-9096a1e03627 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Returning 404 to user: Volume 1e218766-9201-4126-9c98-ecc6c7416ee6 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:45.761584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-188c22ff-15c6-4b7c-8bcb-9096a1e03627 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6" status: 404 len: 109 microversion: 2.1 time: 0.082608 Nov 11 01:02:45.762326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 29/50] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Nov 11 01:02:45 2021] DELETE /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:45.932321 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ffdf79ab-6779-4f3b-ac5c-861a230eb6da tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'create', calling method: .version_select at 0x7fd3644d2a60>, body: {"keypair": {"name": "tempest-keypair-1329287288"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:46.013195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-ffdf79ab-6779-4f3b-ac5c-861a230eb6da tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:46.031440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-ffdf79ab-6779-4f3b-ac5c-861a230eb6da tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for user 4d1219c765c74dcc8bb8b61d4615e0c6 and project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:46.223677 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:02:46.224300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:02:46.224563 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:02:46.224962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:02:46.225711 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:02:46.239754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:46.242193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:46.247710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:46.249508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:46.297286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Getting quotas for project 4b9ddce0b6794348af30770172bcd5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:46.314782 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Getting quotas for user 8f6a452de8074d36a36c14c6e46cb3be and project 4b9ddce0b6794348af30770172bcd5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:46.343301 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:02:46.345481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:02:46.430613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-27e98a76-c688-4437-a0e7-4fca7db0fc7f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.498037 Nov 11 01:02:46.437286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 22/51] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:02:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:02:46.451479 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-befc1f96-8428-413a-bbae-582109844d50 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Calling method '.version_select at 0x7fd364530c10>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:46.507871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-befc1f96-8428-413a-bbae-582109844d50 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] HTTP exception thrown: Volume 1e218766-9201-4126-9c98-ecc6c7416ee6 could not be found. Nov 11 01:02:46.508818 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-befc1f96-8428-413a-bbae-582109844d50 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] Returning 404 to user: Volume 1e218766-9201-4126-9c98-ecc6c7416ee6 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:46.510448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-befc1f96-8428-413a-bbae-582109844d50 tempest-VolumesSnapshotsTestJSON-490573003 tempest-VolumesSnapshotsTestJSON-490573003-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6" status: 404 len: 109 microversion: 2.1 time: 0.071920 Nov 11 01:02:46.511525 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 23/52] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:46 2021] GET /compute/v2.1/os-volumes/1e218766-9201-4126-9c98-ecc6c7416ee6 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:46.518361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:46.520464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:46.550668 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:46.556213 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:46.559267 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:46.560628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:46.624200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-ffdf79ab-6779-4f3b-ac5c-861a230eb6da tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:46.634720 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-ffdf79ab-6779-4f3b-ac5c-861a230eb6da tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for user 4d1219c765c74dcc8bb8b61d4615e0c6 and project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:46.680853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ffdf79ab-6779-4f3b-ac5c-861a230eb6da tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.916879 Nov 11 01:02:46.682124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 30/53] 10.222.0.52 () {62 vars in 1198 bytes} [Thu Nov 11 01:02:45 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 919 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 11 01:02:46.690198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-81db9e91-875b-4004-87ea-aca1e7d0d56d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:46.693200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-81db9e91-875b-4004-87ea-aca1e7d0d56d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:46.955015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:46.965836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6319567b-7ec0-4c1c-b6c1-2aa064bf77a3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1276 microversion: 2.1 time: 0.453042 Nov 11 01:02:46.971654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 24/54] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:46 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:46.985621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:46.992354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:47.024926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:47.039264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:47.040735 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:47.044334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:47.058493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-81db9e91-875b-4004-87ea-aca1e7d0d56d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:47.068778 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-81db9e91-875b-4004-87ea-aca1e7d0d56d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1221 microversion: 2.1 time: 0.383747 Nov 11 01:02:47.072087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 31/55] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:46 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1221 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:47.420954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:47.430966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-47538adc-531d-4d6d-931c-641a43ec8362 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1272 microversion: 2.1 time: 0.448871 Nov 11 01:02:47.434637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 25/56] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:46 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1272 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:47.504445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1311727325", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288ad7ee-ad49-45cc-b619-30fceacb55ee"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:47.673640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] validate_networks() for [('288ad7ee-ad49-45cc-b619-30fceacb55ee', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:02:47.990207 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:47.991213 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:48.005499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:48.005967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:48.014661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:48.015176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:48.306338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:48.324278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-31fb52da-739c-43e3-8afa-aa49ac7de77a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1276 microversion: 2.1 time: 0.338960 Nov 11 01:02:48.328538 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 26/57] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:47 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:02:48.451285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:48.452379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:48.476061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:48.476871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:48.477996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:48.478933 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:49.792115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:02:49.792628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:02:49.793011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:02:49.793423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:02:49.793833 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:02:49.810215 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:49.810935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:49.811958 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:49.812555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:49.867591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Getting quotas for project 4b9ddce0b6794348af30770172bcd5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:49.884940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Getting quotas for user 8f6a452de8074d36a36c14c6e46cb3be and project 4b9ddce0b6794348af30770172bcd5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:49.924658 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:02:49.927632 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:02:50.007821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:50.023690 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-971942d1-dc38-4943-b979-55f41f1ce6c0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 1.577161 Nov 11 01:02:50.024772 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 27/58] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:48 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:02:50.047830 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:50.054137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:50.084022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:50.084532 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:50.085368 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:50.090146 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:50.100517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a6cfe120-3eea-4b30-af61-7125cd7e15ed tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.601189 Nov 11 01:02:50.105931 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 32/59] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:02:47 2021] POST /compute/v2.1/servers => generated 383 bytes in 2607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:02:50.130178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-728183ce-2525-4791-aad2-b8ba89d668a5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:50.142813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-728183ce-2525-4791-aad2-b8ba89d668a5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:50.337073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-728183ce-2525-4791-aad2-b8ba89d668a5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:50.344652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-728183ce-2525-4791-aad2-b8ba89d668a5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1222 microversion: 2.1 time: 0.230442 Nov 11 01:02:50.345372 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 33/60] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:50 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:50.466914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:50.480804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-17e2fae1-d1ab-431d-92a6-aa852a806145 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.449431 Nov 11 01:02:50.482495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 28/61] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:50 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:51.043342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:51.044694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:51.052039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:51.056124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:51.058282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:51.065397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:51.362880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:51.365170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:51.375533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:51.379622 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:51.380795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:51.381424 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:51.651539 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:51.668968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-aca45826-ef59-40cf-9514-af707462fcd0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1218 microversion: 2.1 time: 0.303793 Nov 11 01:02:51.674562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 29/62] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:51 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1218 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:51.684040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:51.699974 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:51.712854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:51.715833 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:51.721187 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:51.723333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:52.069294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:52.087791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-444fa186-8157-4287-b4b0-e65484383dc3 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 1.049505 Nov 11 01:02:52.089212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 34/63] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:51 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:52.576053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-784c2cb6-89f0-448e-8d08-2f8ffa0a5377 tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Action: 'create', calling method: .version_select at 0x7fd3644d1430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2056323511", "metadata": {"Type": "work"}}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:52.604780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:52.618338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-39e365dd-edb5-4e84-8bcb-107ef1832215 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.942290 Nov 11 01:02:52.620028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 30/64] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:51 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:52.697503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:52.698513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:52.714729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:52.715416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:52.717043 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:52.717546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:52.931272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:52.944337 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7b99c7ae-22b6-4a80-91c6-6735105967a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1274 microversion: 2.1 time: 0.255109 Nov 11 01:02:52.945129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 31/65] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:52 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:53.105020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:53.105840 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:53.116709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:53.123170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:53.124448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:53.130003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:53.287804 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-784c2cb6-89f0-448e-8d08-2f8ffa0a5377 tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.196991 Nov 11 01:02:53.289099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 35/66] 10.222.0.52 () {60 vars in 1155 bytes} [Thu Nov 11 01:02:52 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1199 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 11 01:02:53.300671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-734f41b7-4b55-497f-b712-5d20a19f5e3b tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Calling method '.version_select at 0x7fd3644f04c0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:53.412683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-734f41b7-4b55-497f-b712-5d20a19f5e3b tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c" status: 200 len: 353 microversion: 2.1 time: 0.116261 Nov 11 01:02:53.413831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 36/67] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:53 2021] GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:53.635466 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:53.636444 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:53.646155 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:53.659726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:53.661176 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:53.661836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:53.703054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:53.717647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0dce613a-7936-4bfa-8d0c-6a80cfc6e96c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.616861 Nov 11 01:02:53.728782 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 32/68] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:53 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:53.965907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:53.966527 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:53.987364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:53.990687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:53.992050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:53.994147 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:54.249752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:54.271845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d676cb81-027c-471b-911e-9db2fd8e840b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1292 microversion: 2.1 time: 0.310603 Nov 11 01:02:54.273981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:53 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1292 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:02:54.426772 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fb729564-cd32-4716-9601-71dc73bb539c tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Calling method '.version_select at 0x7fd36453fa60>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:54.604036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fb729564-cd32-4716-9601-71dc73bb539c tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c" status: 200 len: 354 microversion: 2.1 time: 0.181974 Nov 11 01:02:54.605358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 34/70] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:54 2021] GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:54.617358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d64809c7-832b-4eb3-b392-fc996b77d356 tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Calling method '.version_select at 0x7fd36453f9d0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:54.806810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d64809c7-832b-4eb3-b392-fc996b77d356 tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c" status: 200 len: 354 microversion: 2.1 time: 0.194329 Nov 11 01:02:54.808626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 35/71] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:54 2021] GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:54.815154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:54.816341 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:54.836037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:54.836037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:54.836381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:54.840158 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:55.041124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:55.048950 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c6190035-5d01-476a-bc17-355a4ff1e181 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 1.417024 Nov 11 01:02:55.051839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 37/72] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:53 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:02:55.069608 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-795dec8a-cd78-4fe3-af9f-ead7b4e235f8 tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Calling method '.version_select at 0x7fd3644c9af0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:55.287103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-795dec8a-cd78-4fe3-af9f-ead7b4e235f8 tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c" status: 202 len: 0 microversion: 2.1 time: 0.230977 Nov 11 01:02:55.290969 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 38/73] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Nov 11 01:02:55 2021] DELETE /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:02:55.296815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:55.297679 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:55.334315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:55.341227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:55.345063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:55.347990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:55.647857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:55.673108 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fa7583e3-1f94-42a2-80f7-eb22e99a45f6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1280 microversion: 2.1 time: 0.378773 Nov 11 01:02:55.675270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 39/74] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:55 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1280 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:55.702090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a1f5125d-789a-475a-94ab-36b94c55830f tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Calling method '.version_select at 0x7fd3644d1040>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:55.767129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-a1f5125d-789a-475a-94ab-36b94c55830f tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] HTTP exception thrown: Volume f3132cb1-50f3-42d7-9dca-82da946e1f1c could not be found. Nov 11 01:02:55.771149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a1f5125d-789a-475a-94ab-36b94c55830f tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] Returning 404 to user: Volume f3132cb1-50f3-42d7-9dca-82da946e1f1c could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:02:55.772305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a1f5125d-789a-475a-94ab-36b94c55830f tempest-VolumesGetTestJSON-1285664661 tempest-VolumesGetTestJSON-1285664661-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c" status: 404 len: 109 microversion: 2.1 time: 0.093989 Nov 11 01:02:55.773095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 40/75] 10.222.0.52 () {58 vars in 1244 bytes} [Thu Nov 11 01:02:55 2021] GET /compute/v2.1/os-volumes/f3132cb1-50f3-42d7-9dca-82da946e1f1c => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:02:56.073509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:56.074233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:56.090031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:56.090495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:56.091625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:56.092112 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:56.224387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:56.247612 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-02187e3d-fd0d-4d2a-a7ff-5246efc9d9c4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 1.437544 Nov 11 01:02:56.249127 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 36/76] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:54 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:56.362856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2134184176", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7db40340-76c1-4dbb-a60c-57c8a9a269e5"}], "security_groups": [{"name": "tempest-securitygroup--1981934822"}], "key_name": "tempest-keypair-1329287288", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:56.871201 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] validate_networks() for [('7db40340-76c1-4dbb-a60c-57c8a9a269e5', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:02:56.940004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:56.953118 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ab1db4cd-ee87-42bb-9000-c35cd17e5e86 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.884053 Nov 11 01:02:56.973636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 41/77] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:56 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:57.108452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-573136c8-04a8-48df-a8f7-b915c5ebb0eb req-976e6ee2-fdc4-45f0-8bea-168ac8cb8f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0360cc95-5544-4fb1-bc22-e5597a623fc0", "tag": "e550141e-b3f0-40cc-9ff5-80a4761a4f92"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:57.110790 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:02:57.110790 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:02:57.142890 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-573136c8-04a8-48df-a8f7-b915c5ebb0eb req-976e6ee2-fdc4-45f0-8bea-168ac8cb8f49 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.148926 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-573136c8-04a8-48df-a8f7-b915c5ebb0eb req-976e6ee2-fdc4-45f0-8bea-168ac8cb8f49 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:57.204193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-573136c8-04a8-48df-a8f7-b915c5ebb0eb req-976e6ee2-fdc4-45f0-8bea-168ac8cb8f49 service nova] Creating event network-changed:e550141e-b3f0-40cc-9ff5-80a4761a4f92 for instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 on hv-cinder-81708 Nov 11 01:02:57.207010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-573136c8-04a8-48df-a8f7-b915c5ebb0eb req-976e6ee2-fdc4-45f0-8bea-168ac8cb8f49 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 11 01:02:57.208683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-924a9261-bc8f-4150-951f-6296373f328d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.211867 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-924a9261-bc8f-4150-951f-6296373f328d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:57.214143 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-924a9261-bc8f-4150-951f-6296373f328d None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.219286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-924a9261-bc8f-4150-951f-6296373f328d None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:57.232565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.compute.rpcapi [None req-924a9261-bc8f-4150-951f-6296373f328d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 11 01:02:57.236034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-924a9261-bc8f-4150-951f-6296373f328d None None] Releasing lock "compute-rpcapi-router" {{(pid=116015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 11 01:02:57.313166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-924a9261-bc8f-4150-951f-6296373f328d None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337491 Nov 11 01:02:57.314571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 42/78] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:02:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:57.322375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:57.325962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:57.337591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.338007 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:57.341657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.342113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:57.710370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:57.733879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-681a5f8d-298c-45c9-96af-42887afc4330 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1280 microversion: 2.1 time: 0.415408 Nov 11 01:02:57.736946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 43/79] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:57 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1280 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:57.776981 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:57.790878 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:57.821377 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.826919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:57.832824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:57.833381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:58.770028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:58.778842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5854ebea-ed41-4e51-a0c5-bdf42433aad2 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 1.039447 Nov 11 01:02:58.808311 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 44/80] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:57 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:58.815498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:58.819128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:58.835062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:58.835519 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:58.836309 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:58.836913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.392261 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:02:59.392779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:02:59.393478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:02:59.394343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:02:59.395261 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:02:59.418418 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.421621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.424487 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.425129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.476806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for project e01554f5a96c46afb1983c71a9513e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:02:59.487139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for user 4d1219c765c74dcc8bb8b61d4615e0c6 and project e01554f5a96c46afb1983c71a9513e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:02:59.520814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:02:59.527971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:02:59.616730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:02:59.625676 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-813f561f-cb9a-4ed5-b7d1-d32307844c7e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.822021 Nov 11 01:02:59.626274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 45/81] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:58 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:02:59.642678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:59.646417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:02:59.656378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f2ddc3c3-756e-467d-8cb2-8fe90447ccc3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.298297 Nov 11 01:02:59.657933 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 37/82] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Nov 11 01:02:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 11 01:02:59.671459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-7807d47b-1720-4f14-976a-6880fa104d1a req-551f35a0-9e00-4197-80b8-23b676ad7922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61a1f6b-3738-404f-a57c-38c3e25aca4d", "tag": "05b60e97-4d8c-4758-b07d-22fad0adb972"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:02:59.671645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.672517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.673348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.674823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:02:59.674823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:02:59.675055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.689948 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7807d47b-1720-4f14-976a-6880fa104d1a req-551f35a0-9e00-4197-80b8-23b676ad7922 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.690762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7807d47b-1720-4f14-976a-6880fa104d1a req-551f35a0-9e00-4197-80b8-23b676ad7922 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.733282 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-7807d47b-1720-4f14-976a-6880fa104d1a req-551f35a0-9e00-4197-80b8-23b676ad7922 service nova] Creating event network-changed:05b60e97-4d8c-4758-b07d-22fad0adb972 for instance a61a1f6b-3738-404f-a57c-38c3e25aca4d on hv-cinder-81708 Nov 11 01:02:59.734911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7807d47b-1720-4f14-976a-6880fa104d1a req-551f35a0-9e00-4197-80b8-23b676ad7922 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 11 01:02:59.736808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.737637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.739677 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:02:59.740791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:02:59.753881 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.compute.rpcapi [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 11 01:02:59.755424 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] Releasing lock "compute-rpcapi-router" {{(pid=116016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 11 01:02:59.784173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-da7e1e92-f778-4559-b81e-f73c5ecd61ac None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124505 Nov 11 01:02:59.785165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 38/83] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:02:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:02:59.807004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c462504c-4c8a-4483-94d0-5e19b58b2c6a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:02:59.808268 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c462504c-4c8a-4483-94d0-5e19b58b2c6a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:00.002445 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c462504c-4c8a-4483-94d0-5e19b58b2c6a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:00.028637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c462504c-4c8a-4483-94d0-5e19b58b2c6a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:00.032544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c462504c-4c8a-4483-94d0-5e19b58b2c6a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:00.037997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c462504c-4c8a-4483-94d0-5e19b58b2c6a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1282 microversion: 2.20 time: 0.245302 Nov 11 01:03:00.039553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 39/84] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:02:59 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:00.053527 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:00.054377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:00.075013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:00.075638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:00.076845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:00.080614 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:00.344815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:00.353322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8bd408d8-a49e-4773-9e01-9e952a9e75b5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.726022 Nov 11 01:03:00.355615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 46/85] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:02:59 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:00.643227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:00.643849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:00.654779 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:00.656081 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:00.658828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:00.659411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:00.954076 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:00.963842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-33e6addc-39e2-4f24-a129-901a6401bb38 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.922713 Nov 11 01:03:00.967662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 40/86] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:00 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:01.057824 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:01.058643 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:01.071367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:01.071989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:01.075031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:01.084279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:01.383918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:01.393303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:01.398045 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:01.400199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-67424484-cd20-42f4-8e14-20704dec6553 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1334 microversion: 2.20 time: 0.348028 Nov 11 01:03:01.404899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 41/87] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:01 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1334 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:01.564661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:01.587890 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ead4300b-7aeb-4214-bfe3-0a6b5f51309d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.948662 Nov 11 01:03:01.595334 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 47/88] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:00 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:01.611405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:01.614328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:01.627463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:01.640370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:01.641724 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:01.643416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:01.799235 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-dcbd8cbd-a527-41ed-b225-bdbb1a56bb0e req-87e8c57a-f716-4e59-a386-b156feb204a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45620e84-de01-477d-a818-263dae68f119", "tag": "82da993e-a127-427f-9c31-a8b1a4846d8f"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:01.802040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:01.802040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:03:01.820836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-dcbd8cbd-a527-41ed-b225-bdbb1a56bb0e req-87e8c57a-f716-4e59-a386-b156feb204a7 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:01.826529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-dcbd8cbd-a527-41ed-b225-bdbb1a56bb0e req-87e8c57a-f716-4e59-a386-b156feb204a7 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:01.853291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-dcbd8cbd-a527-41ed-b225-bdbb1a56bb0e req-87e8c57a-f716-4e59-a386-b156feb204a7 service nova] Creating event network-changed:82da993e-a127-427f-9c31-a8b1a4846d8f for instance 45620e84-de01-477d-a818-263dae68f119 on hv-cinder-81708 Nov 11 01:03:01.882906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-dcbd8cbd-a527-41ed-b225-bdbb1a56bb0e req-87e8c57a-f716-4e59-a386-b156feb204a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.471734 Nov 11 01:03:01.887536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 42/89] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:01.985470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:01.986179 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:02.000588 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:02.001031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:02.001833 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:02.002264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:02.482265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:02.492940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fd3e96ab-103c-46c2-a260-a4d91ad0a71c tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.511647 Nov 11 01:03:02.507763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 43/90] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:01 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:02.519868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:02.520501 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:02.533542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:02.533995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:02.535741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:02.536182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:02.752632 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:02.768226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-68f68c76-810a-4aeb-a0b3-65637194406a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 1.170045 Nov 11 01:03:02.770082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 48/91] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:01 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:02.776908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:02.778536 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:02.787852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:02.789253 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:02.790331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:02.791891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:02.807776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:02.828422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:02.834013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:02.839959 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8020e7c9-bd4c-4269-99d2-290c1794da9d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1340 microversion: 2.20 time: 0.331094 Nov 11 01:03:02.840756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 44/92] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:02 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1340 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:03.336676 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:03.345769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b84b66fe-8116-4896-b043-cd59a70b2173 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.574067 Nov 11 01:03:03.356430 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 49/93] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:02 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:03.514385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:03.516703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:03.536297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:03.536962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:03.539784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:03.540329 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:03.789112 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:03.790440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:03.798861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:03.799607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:03.801341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:03.802690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:04.194549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:04.202625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9924c6ee-9c72-4626-a11e-3b39b30f58e4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.693819 Nov 11 01:03:04.203265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 45/94] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:03 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:04.221499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:04.223286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:04.224217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:04.232845 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a16a656e-931e-4b07-b4e6-f179a8b86d1f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.450474 Nov 11 01:03:04.235192 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:04.239381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:04.240486 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:04.241562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:04.245978 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 50/95] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:03 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:04.258234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-5c036f78-e3cf-464f-a983-b6e00cfb53a2 req-fdd7cb5b-be2a-4f39-a049-386516f28828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60ae7a9-6eb4-4a87-88ca-6c291f834861", "tag": "5cfe983d-38d0-4d2b-870d-35adc82de8f4"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:04.262488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:04.262488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:03:04.279491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-5c036f78-e3cf-464f-a983-b6e00cfb53a2 req-fdd7cb5b-be2a-4f39-a049-386516f28828 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:04.280206 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-5c036f78-e3cf-464f-a983-b6e00cfb53a2 req-fdd7cb5b-be2a-4f39-a049-386516f28828 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:04.295125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-5c036f78-e3cf-464f-a983-b6e00cfb53a2 req-fdd7cb5b-be2a-4f39-a049-386516f28828 service nova] Creating event network-changed:5cfe983d-38d0-4d2b-870d-35adc82de8f4 for instance f60ae7a9-6eb4-4a87-88ca-6c291f834861 on hv-cinder-81708 Nov 11 01:03:04.304268 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-5c036f78-e3cf-464f-a983-b6e00cfb53a2 req-fdd7cb5b-be2a-4f39-a049-386516f28828 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056395 Nov 11 01:03:04.305677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 51/96] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:04.372572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:04.373768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:04.380245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:04.385148 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:04.386434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:04.387854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:04.389059 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:04.402109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:04.404407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:04.406069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0f28a96c-fba8-4df5-9e7a-b35685537999 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1340 microversion: 2.20 time: 0.196830 Nov 11 01:03:04.407299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 46/97] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:04 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1340 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:04.578262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:04.595357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2ecbf982-223e-4f1c-8992-35232ca26fb4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.231602 Nov 11 01:03:04.597986 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 52/98] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:04 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:05.220969 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:05.221580 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:05.228334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.233094 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.238330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.243315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.257694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:05.258990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:05.289730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.290580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.298898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.299594 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.746607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:05.762698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0b0f572e-c2c3-4e09-b972-a0a8776e84d0 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.545457 Nov 11 01:03:05.775997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 47/99] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:05 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:05.782762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:05.783359 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:05.796703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.797374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.798363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.798998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.819235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:05.835284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4467e10e-5525-4188-9b45-2210d44e860f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.585162 Nov 11 01:03:05.840178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 53/100] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:05 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:05.851407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:05.856471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:05.882074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.882654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:05.884646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:05.885096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:06.425270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:06.433790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:06.435325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:06.436438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-512b3bc2-2c55-4ce2-8ca9-fe299fc069cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.659383 Nov 11 01:03:06.437004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 48/101] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:05 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:06.504872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:06.513790 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c85135b2-eb37-48eb-996b-379c2d9fb04f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.669945 Nov 11 01:03:06.523614 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 54/102] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:05 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:06.787776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:06.788701 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:06.796004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:06.797824 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:06.799586 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:06.801290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:06.863175 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:06.864142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:06.881884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:06.883271 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:06.886363 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:06.886813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:07.318823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:07.328383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-66150880-238f-4202-bc08-f4864d7cd234 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.475085 Nov 11 01:03:07.345855 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 55/103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:06 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:07.356422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:07.374866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-0bf4a7e2-208d-40f1-acea-ded02f79e4bc req-5de7c681-c236-4b38-a972-73c0de50829c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:07.376041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4a4a6019-f416-43a5-bf40-1c7d0065010a tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.593726 Nov 11 01:03:07.377149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 49/104] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:06 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:07.386861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:07.386861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:03:07.398233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-0bf4a7e2-208d-40f1-acea-ded02f79e4bc req-5de7c681-c236-4b38-a972-73c0de50829c service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:07.398678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-0bf4a7e2-208d-40f1-acea-ded02f79e4bc req-5de7c681-c236-4b38-a972-73c0de50829c service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:07.414877 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-0bf4a7e2-208d-40f1-acea-ded02f79e4bc req-5de7c681-c236-4b38-a972-73c0de50829c service nova] Creating event network-changed:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:03:07.420952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-0bf4a7e2-208d-40f1-acea-ded02f79e4bc req-5de7c681-c236-4b38-a972-73c0de50829c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073585 Nov 11 01:03:07.421559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 56/105] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:07.454784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:07.456144 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:07.476421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:07.478013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:07.481015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:07.482235 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:07.534069 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:07.536395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:07.549472 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:07.550788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:07.553833 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:07.554429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:08.054615 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:08.064311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:08.070038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:08.080177 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:08.084568 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c0b5c9dc-c3a1-4c8d-ab54-f40ce60051b4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.555984 Nov 11 01:03:08.096079 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4b90d3de-c417-4500-86a9-b9f769404081 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.645175 Nov 11 01:03:08.108273 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 57/106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:07 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:08.110132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 50/107] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:07 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:08.355184 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:08.356046 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:08.367630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:08.370201 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:08.375729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:08.377496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:08.540004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-13e951ec-0e39-4631-8e39-5cf5184fc0db req-9b81ad5a-a484-44cb-ac40-c9c2deeda5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0360cc95-5544-4fb1-bc22-e5597a623fc0", "name": "network-vif-plugged", "status": "completed", "tag": "e550141e-b3f0-40cc-9ff5-80a4761a4f92"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:08.541746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:08.541746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:03:08.550732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-13e951ec-0e39-4631-8e39-5cf5184fc0db req-9b81ad5a-a484-44cb-ac40-c9c2deeda5ac service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:08.551521 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-13e951ec-0e39-4631-8e39-5cf5184fc0db req-9b81ad5a-a484-44cb-ac40-c9c2deeda5ac service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:08.569497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-13e951ec-0e39-4631-8e39-5cf5184fc0db req-9b81ad5a-a484-44cb-ac40-c9c2deeda5ac service nova] Creating event network-vif-plugged:e550141e-b3f0-40cc-9ff5-80a4761a4f92 for instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 on hv-cinder-81708 Nov 11 01:03:08.575740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-13e951ec-0e39-4631-8e39-5cf5184fc0db req-9b81ad5a-a484-44cb-ac40-c9c2deeda5ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.465568 Nov 11 01:03:08.577446 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 58/108] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:08.585454 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:08.586419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:08.593917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:08.594717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:08.596288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:08.596979 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:08.626059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:08.641868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7025f8fc-0145-40e8-bbae-eb11c568137f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.291212 Nov 11 01:03:08.642465 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 51/109] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:08 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:08.802103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:08.813819 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b2edfb77-2fa6-4aa7-ba22-7539c34656a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.234357 Nov 11 01:03:08.814494 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 59/110] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:08 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:09.101997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:09.102708 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:09.108462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.112318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.115582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.116253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.116834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:09.118103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:09.126741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.130037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.131111 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.133036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.391074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:09.401748 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b4119f2d-4c05-42a7-8c03-f2c1071cbc71 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.303318 Nov 11 01:03:09.402342 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 52/111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:09 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:09.438655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:09.451039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:09.453505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:09.455259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-545a1f55-c65e-47da-8034-0aa77df306fd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.344203 Nov 11 01:03:09.469147 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 60/112] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:09 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:09.660025 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:09.660722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:09.668975 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.669442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.670248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.670672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.831946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:09.832799 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:09.843755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.845552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.848775 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:09.849463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:09.874700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:09.884310 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-57c5cf00-6e1e-4438-9462-0b5c240ba775 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.226497 Nov 11 01:03:09.895210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 53/113] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:09 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:10.090545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:10.106861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-afb80e27-2852-46cb-9bdd-b0cdc208bdf6 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.279418 Nov 11 01:03:10.125196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 61/114] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:09 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:10.420038 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:10.420303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:10.426320 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.427039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:10.428090 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.428986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:10.475314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:10.476176 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:10.482398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.483289 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:10.484537 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.485383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:10.610048 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:10.618258 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-87dedeab-bda4-4f4f-b8d1-669134699e10 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.202802 Nov 11 01:03:10.619280 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 54/115] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:10 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:10.625153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-ac53e08e-0ae0-4915-93f9-5cda3a93fd73 req-293181a7-60b1-4300-8f6e-88ac56c3f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61a1f6b-3738-404f-a57c-38c3e25aca4d", "name": "network-vif-plugged", "status": "completed", "tag": "05b60e97-4d8c-4758-b07d-22fad0adb972"}, {"server_uuid": "45620e84-de01-477d-a818-263dae68f119", "name": "network-vif-plugged", "status": "completed", "tag": "82da993e-a127-427f-9c31-a8b1a4846d8f"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:10.627134 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:10.627134 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:03:10.636075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-ac53e08e-0ae0-4915-93f9-5cda3a93fd73 req-293181a7-60b1-4300-8f6e-88ac56c3f7b0 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.636513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-ac53e08e-0ae0-4915-93f9-5cda3a93fd73 req-293181a7-60b1-4300-8f6e-88ac56c3f7b0 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:10.649883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-ac53e08e-0ae0-4915-93f9-5cda3a93fd73 req-293181a7-60b1-4300-8f6e-88ac56c3f7b0 service nova] Creating event network-vif-plugged:05b60e97-4d8c-4758-b07d-22fad0adb972 for instance a61a1f6b-3738-404f-a57c-38c3e25aca4d on hv-cinder-81708 Nov 11 01:03:10.650459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-ac53e08e-0ae0-4915-93f9-5cda3a93fd73 req-293181a7-60b1-4300-8f6e-88ac56c3f7b0 service nova] Creating event network-vif-plugged:82da993e-a127-427f-9c31-a8b1a4846d8f for instance 45620e84-de01-477d-a818-263dae68f119 on hv-cinder-81708 Nov 11 01:03:10.657860 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-ac53e08e-0ae0-4915-93f9-5cda3a93fd73 req-293181a7-60b1-4300-8f6e-88ac56c3f7b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036970 Nov 11 01:03:10.659228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 55/116] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:10 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:10.693612 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:10.702152 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:10.703695 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:10.704774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-980bbb46-43d6-4519-bf1c-109eb1680695 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.233947 Nov 11 01:03:10.705719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 62/117] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:10 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:10.903393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:10.904637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:10.911709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.912540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:10.913334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:10.913782 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.061224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:11.071345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-86d7ece1-5233-4cf2-a9d2-cdc4ea843e21 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.171917 Nov 11 01:03:11.072019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 56/118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:10 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:11.139357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:11.139972 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:11.146240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:11.146806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.147671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:11.148133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.296878 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:11.304427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-96bebdd2-0e12-411c-8cd1-8c740caefeff tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.168674 Nov 11 01:03:11.304997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 63/119] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:11 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:11.635012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:11.635672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:11.641711 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:11.642164 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.642973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:11.643459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.723442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:11.724534 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:11.730966 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:11.731568 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.732615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:11.733139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:11.787064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:11.794225 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0559e634-f789-4ec6-9555-7900e9744f69 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.162908 Nov 11 01:03:11.794857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 57/120] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:11 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:11.872243 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:11.879906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:11.881408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:11.882484 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-11b0e341-5b8e-4d3c-a59f-ba56d8b973e3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.162952 Nov 11 01:03:11.883048 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 64/121] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:11 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:12.088312 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:12.089733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:12.095913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.096363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.097484 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.097927 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.240766 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:12.248364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-17a17d22-93a2-4052-820f-6641d3a83bd8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.163623 Nov 11 01:03:12.248935 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 58/122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:12 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:12.325175 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:12.325791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:12.332274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.332728 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.333507 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.333932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.475562 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:12.482835 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-754f4a11-addf-4f5e-b45c-4525fc4c0e00 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.161249 Nov 11 01:03:12.483513 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 65/123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:12 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:12.678060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-7037d318-a914-4516-97a9-78dac1d289db req-d1bd67fb-0363-487a-8f31-dc2a65015ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60ae7a9-6eb4-4a87-88ca-6c291f834861", "name": "network-vif-plugged", "status": "completed", "tag": "5cfe983d-38d0-4d2b-870d-35adc82de8f4"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:12.679614 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:12.679614 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:03:12.686812 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7037d318-a914-4516-97a9-78dac1d289db req-d1bd67fb-0363-487a-8f31-dc2a65015ebb service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.687284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7037d318-a914-4516-97a9-78dac1d289db req-d1bd67fb-0363-487a-8f31-dc2a65015ebb service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.700051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-7037d318-a914-4516-97a9-78dac1d289db req-d1bd67fb-0363-487a-8f31-dc2a65015ebb service nova] Creating event network-vif-plugged:5cfe983d-38d0-4d2b-870d-35adc82de8f4 for instance f60ae7a9-6eb4-4a87-88ca-6c291f834861 on hv-cinder-81708 Nov 11 01:03:12.705219 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-7037d318-a914-4516-97a9-78dac1d289db req-d1bd67fb-0363-487a-8f31-dc2a65015ebb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031320 Nov 11 01:03:12.705813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 59/124] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:12.811774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:12.812423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:12.818915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.819403 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.820173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.820609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.901460 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:12.902095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:12.908187 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.908636 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.909638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:12.910109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:12.985941 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:12.994623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6d2c91d1-1faa-4d7b-bdec-c7c8bb055159 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.186512 Nov 11 01:03:12.995410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 66/125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:12 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:13.052287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:13.059980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:13.061473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:13.062566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c41605ce-965e-4c11-b754-972bc4614cfb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.165308 Nov 11 01:03:13.063145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 60/126] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:12 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:13.266336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:13.267250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:13.273776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:13.274224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:13.275180 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:13.275615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:13.434034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:13.442223 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6ac1563a-d8c8-4fa4-b0fb-5ea3632e7c59 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.180407 Nov 11 01:03:13.452055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 67/127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:13 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:13.501866 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:13.503729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:13.510428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:13.511055 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:13.512041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:13.513509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:13.657270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:13.665907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-372c7353-8a14-41ea-b2b4-1a9bb1bb4d65 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.168232 Nov 11 01:03:13.666493 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 61/128] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:13 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:14.013961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:14.014907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:14.031207 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.031698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.032555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.032963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.080478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:14.081262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:14.087463 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.088019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.089138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.089643 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.265861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:14.275357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9031060b-366a-445e-bac6-eca9d4b768a8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.267243 Nov 11 01:03:14.276121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 68/129] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:14 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:14.335245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:14.343684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:14.345903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:14.347228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c9b81701-4c81-4148-98f3-b4c3badac003 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.270314 Nov 11 01:03:14.347795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 62/130] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:14 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:14.459388 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:14.460019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:14.465933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.466379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.467182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.467616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.603377 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:14.610565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e4ff67ca-e2cb-4815-b94c-331f7e1e7f4c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.155442 Nov 11 01:03:14.611171 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 69/131] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:14 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:14.682708 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:14.683350 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:14.689244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.689737 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.690513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:14.691546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:14.822878 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:14.830012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1e9bf494-387a-432b-8c63-12ec43e26fd4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1314 microversion: 2.1 time: 0.150920 Nov 11 01:03:14.830586 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 63/132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:14 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:15.291957 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:15.292525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:15.298747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.299430 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.301013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.301522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.364114 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:15.365541 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:15.373815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.374507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.375489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.376065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.480123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:15.499727 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-316664fa-309d-4660-87da-74859b7be11c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.211348 Nov 11 01:03:15.501010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 70/133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:15 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:15.516910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-c72002a1-e621-4698-9755-d005c723673c req-0c3b8c94-dc3f-4a80-9d1d-efc29754fde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "name": "network-vif-plugged", "status": "completed", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:15.521548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:15.521548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:03:15.535988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-c72002a1-e621-4698-9755-d005c723673c req-0c3b8c94-dc3f-4a80-9d1d-efc29754fde4 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.538539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-c72002a1-e621-4698-9755-d005c723673c req-0c3b8c94-dc3f-4a80-9d1d-efc29754fde4 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.571900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-c72002a1-e621-4698-9755-d005c723673c req-0c3b8c94-dc3f-4a80-9d1d-efc29754fde4 service nova] Creating event network-vif-plugged:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:03:15.585121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-c72002a1-e621-4698-9755-d005c723673c req-0c3b8c94-dc3f-4a80-9d1d-efc29754fde4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072765 Nov 11 01:03:15.587022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 71/134] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:15.606151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:15.617168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:15.619074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:15.620481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ff3c7595-b5ff-4e4f-aa9a-2a5c480d2f3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.260088 Nov 11 01:03:15.621185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 64/135] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:15 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:15.635619 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:15.636326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:15.658065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.658592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.661127 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.661690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.848118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:15.848980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:15.854873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.855540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.856530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:15.856968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:15.866075 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:15.874073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-329248e9-3cb7-4e71-bdc8-e5196ab5cb73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.250241 Nov 11 01:03:15.886022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 72/136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:15 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:16.084857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:16.109791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-070cba37-4cd2-44b4-86de-d48596aa12ba tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1501 microversion: 2.1 time: 0.262955 Nov 11 01:03:16.109791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 65/137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:15 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:16.517677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:16.518275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:16.524327 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:16.524771 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:16.525549 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:16.525982 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:16.639756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:16.640626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:16.647052 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:16.647551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:16.648629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:16.649139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:16.734678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:16.743112 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-da311b80-5876-4e05-979e-23839f7c2d49 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1318 microversion: 2.1 time: 0.229125 Nov 11 01:03:16.743857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 73/138] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:16 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:16.836284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:16.845447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:16.847921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:16.849061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-511b500e-6e86-4850-9de4-ef798ad3f092 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.213317 Nov 11 01:03:16.849787 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 66/139] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:16 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:16.902665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:16.903300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:16.909367 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:16.909772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:16.915125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:16.915125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:17.044017 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:17.051716 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-534144d1-bad9-4866-b1c3-dfc50b6b3109 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1322 microversion: 2.1 time: 0.153215 Nov 11 01:03:17.060849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 74/140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:16 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:17.760839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:17.761535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:17.768453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:17.769103 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:17.769874 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:17.770301 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:17.867780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:17.869018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:17.876731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:17.877175 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:17.878099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:17.878728 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:17.916494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:17.943019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3750e221-6332-452b-9235-065bc67473dc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1508 microversion: 2.1 time: 0.186654 Nov 11 01:03:17.945370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 67/141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:17 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:18.047032 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:18.058053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:18.059587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:18.060741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2d4299f8-97c2-4c1f-bab5-66f6c6ac758e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.196765 Nov 11 01:03:18.061301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 75/142] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:17 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:18.068617 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:18.069299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:18.075552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.076085 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.076924 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.077393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.249182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:18.257000 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0a89853d-af5a-4c60-bc4d-499bd66f6542 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1517 microversion: 2.1 time: 0.192428 Nov 11 01:03:18.257571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 68/143] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:18 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:18.276159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:18.277203 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:18.286221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.287296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.288505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.289436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.427446 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lazy-loading 'flavor' on Instance uuid f60ae7a9-6eb4-4a87-88ca-6c291f834861 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:03:18.523171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b0a1fac-7a4b-4284-8626-b1506d4d4d88"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:18.523171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:18.530382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.531033 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.531821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.532256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.574067 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-79de03ea-dfa9-4633-8558-bac82772e522 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861/action" status: 200 len: 32 microversion: 2.1 time: 0.302187 Nov 11 01:03:18.575070 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 76/144] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:03:18 2021] POST /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:03:18.585086 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:18.585854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:18.593782 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.594310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.595222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:18.595732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:18.795038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:18.803213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-49924bf5-a08a-4ae6-a05c-a710e6906df5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.222893 Nov 11 01:03:18.803795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 77/145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:18 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:19.007011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7d2636f0-4202-458f-9f94-7f4aa1cd3274 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "POST /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484321 Nov 11 01:03:19.007011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 69/146] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:03:18 2021] POST /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:03:19.082514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:19.084456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:19.091054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:19.091719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:19.092500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:19.092932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:19.305345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:19.318076 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:19.320014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:19.321192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dbe55a2c-f05b-4275-99c6-d5300f8db5f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1408 microversion: 2.20 time: 0.245733 Nov 11 01:03:19.331676 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 78/147] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:19 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:19.470123 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d34a6feb-4cdb-45f6-8f8a-879eeea96bc7"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:19.471305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:19.478964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:19.479424 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:19.480232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:19.480645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:19.820692 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:19.820692 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:19.826801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:19.827246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:19.827958 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:19.828396 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:19.914063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5b9c7334-5c01-425e-a913-04dfaf550b6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448339 Nov 11 01:03:19.914887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 70/148] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:03:19 2021] POST /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:19.972688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:19.979996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-711cf5f8-7bbc-4032-8520-4173d22777d5 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.163672 Nov 11 01:03:19.980555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 79/149] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:19 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:20.338978 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:20.339651 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:20.346072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:20.347018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:20.347781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:20.348203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:20.484719 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:20.494151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:20.495715 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:20.496931 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6f3b1449-b1ee-46de-937c-fec145d5e0b5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1599 microversion: 2.20 time: 0.162243 Nov 11 01:03:20.497442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 71/150] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:03:20 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:20.515124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:20.515615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:20.522102 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:20.522633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:20.523505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:20.524002 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:20.605240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3c82bee7-31db-4c36-acc4-7872eb7f092d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093744 Nov 11 01:03:20.605832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 80/151] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Nov 11 01:03:20 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:03:20.998505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:20.999389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:21.006249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:21.006771 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:21.007815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:21.008329 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:21.325689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:21.334421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3a71ff5f-17c6-42c6-b172-dcaf06c55d28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.340556 Nov 11 01:03:21.335096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 72/152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:20 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:22.098041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:22.098980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:22.100517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-edd7d8d6-8286-499f-b262-2eebe6a6e87a req-f2203577-60c6-48ee-9294-a2788b00978a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:22.102129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:22.102129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:03:22.105747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:22.106200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:22.106990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:22.107425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:22.109571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-edd7d8d6-8286-499f-b262-2eebe6a6e87a req-f2203577-60c6-48ee-9294-a2788b00978a service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:22.110201 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-edd7d8d6-8286-499f-b262-2eebe6a6e87a req-f2203577-60c6-48ee-9294-a2788b00978a service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:22.121367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-edd7d8d6-8286-499f-b262-2eebe6a6e87a req-f2203577-60c6-48ee-9294-a2788b00978a service nova] Creating event network-changed:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:03:22.126407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-edd7d8d6-8286-499f-b262-2eebe6a6e87a req-f2203577-60c6-48ee-9294-a2788b00978a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029896 Nov 11 01:03:22.127037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 73/153] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:22.340199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b17ec8df-3403-4425-8d21-f70dd62c7182 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.246014 Nov 11 01:03:22.343623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 81/154] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:22 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:22.354801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:22.355789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:22.362535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:22.363015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:22.363800 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:22.364222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:22.715967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:22.723875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-96d51b82-4dd6-4f05-a962-5e59d25d6ae1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.374520 Nov 11 01:03:22.724451 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 74/155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:22 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:23.353923 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:23.356624 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:23.364927 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:23.365945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:23.367019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:23.367655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:23.564151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-32ca8a1b-5b06-47ab-8307-0663e2d2313d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.214586 Nov 11 01:03:23.565053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 82/156] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:23 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:23.741093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:23.741750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:23.748762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:23.749244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:23.750063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:23.750529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:23.895636 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:23.903107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-297d2124-6f9e-42b8-90cd-d2ebf9e1c92e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.166185 Nov 11 01:03:23.903988 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 75/157] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:23 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:24.576917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:24.578127 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:24.585755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:24.586275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:24.587164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:24.587868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:24.765827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6e822ae6-a5f1-473f-b2ca-bdea5cdb5e38 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.193581 Nov 11 01:03:24.766666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 83/158] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:24 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:24.920859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:24.922123 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:24.931164 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:24.931948 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:24.933265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:24.934319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:25.173064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:25.181763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a590ff9d-0548-40e5-8450-0740b1720fb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.264676 Nov 11 01:03:25.182427 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 76/159] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:24 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:25.779062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:25.782301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:25.790242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:25.790777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:25.792032 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:25.792978 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:26.199970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:26.200587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:26.209385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:26.209836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:26.210896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:26.211365 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:26.366115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:26.373358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-049fb742-76eb-415d-a61d-21a0f7c71d14 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.177977 Nov 11 01:03:26.374387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 77/160] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:26 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:27.390552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:27.391249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:27.397601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:27.398126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:27.398967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:27.399475 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:27.542299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:27.551191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-87ef53ea-9a0c-4bdd-ae4e-637b87118906 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.164150 Nov 11 01:03:27.551763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 78/161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:27 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:28.568043 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:28.570136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:28.574760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:28.575322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:28.576031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:28.576468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:28.730036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:28.737377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-046e702d-f9c3-4ffc-bec9-1c850014941c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.173243 Nov 11 01:03:28.737973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 79/162] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:28 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:29.589963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b478a8b3-70da-4e05-b42c-b0b846ea0de8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 3.816051 Nov 11 01:03:29.590687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 84/163] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:25 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 3818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:29.754322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:29.755074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:29.761850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:29.762394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:29.763288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:29.763813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:29.896288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:29.903622 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d696445d-8fbc-4613-a1bb-556d05e20360 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.153152 Nov 11 01:03:29.904196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 80/164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:29 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:30.602361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:30.603293 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:30.609934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:30.610373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:30.611164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:30.611586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:30.829612 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-554f0edf-83de-4fa3-b30c-9c539a4034d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.231870 Nov 11 01:03:30.830274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 85/165] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:30 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:30.921446 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:30.922091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:30.929658 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:30.930105 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:30.930886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:30.931442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:31.085671 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:31.093468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-100432aa-c18c-48bb-a2fd-5ed75e06b75a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.176244 Nov 11 01:03:31.094049 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 81/166] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:30 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:31.841411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:31.842408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:31.860102 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:31.860553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:31.861336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:31.861849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:31.995032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:31.995518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:32.001490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:32.001939 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:32.002823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:32.003285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:32.010081 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c742a78d-3efc-41df-93ef-f0413c3c6208 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.172472 Nov 11 01:03:32.013486 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 86/167] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:31 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:32.030783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:03:32.110978 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:32.112376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:32.121168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:32.121963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:32.123282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:32.123778 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:32.127043 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ac2ceba7-bc43-47c6-b57b-5182a97d4594 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 204 len: 0 microversion: 2.1 time: 0.135252 Nov 11 01:03:32.128216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 82/168] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:03:31 2021] DELETE /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:03:32.136914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:32.137768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:32.146553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:32.147022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:32.147805 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:32.148238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:32.342328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:32.346500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:32.352195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6f9a2634-44d4-44f4-b7e1-044d040b5485 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.245268 Nov 11 01:03:32.352982 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 87/169] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:32 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:32.363186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-14c271d8-2594-4180-9e7a-b97be0c44c02 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1553 microversion: 2.1 time: 0.223305 Nov 11 01:03:32.363186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 83/170] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:32 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:33.022444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:33.023456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:33.035107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:33.035783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:33.036723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:33.037309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:33.217250 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-20199a3d-736e-469b-ab05-dc7138389219 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.199122 Nov 11 01:03:33.220694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 84/171] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:33 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:33.369129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:33.370508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:33.374899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:33.375745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:33.379839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:33.380688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:33.382449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:33.383127 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:33.385835 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:33.386332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:33.387151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:33.387627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:33.689647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:33.700473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d31e2a9f-253b-4816-9724-db8fda33d0c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.335135 Nov 11 01:03:33.700857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:33.701177 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 88/172] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:33 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:33.711037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-165750be-44e2-4a91-a9d3-0b2076f57334 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1553 microversion: 2.1 time: 0.341012 Nov 11 01:03:33.714221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 85/173] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:33 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:34.228377 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:34.229357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:34.235849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:34.236290 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:34.237566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:34.238124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:34.430539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e89edeb4-b648-47ed-b56f-2ba9c015c22f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.206165 Nov 11 01:03:34.431600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 89/174] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:34 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:34.719797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:34.720407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:34.731182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:34.731645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:34.732355 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:34.732471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:34.732844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:34.733268 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:34.742703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:34.743328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:34.744128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:34.744572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:34.932523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:34.941289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b11be286-10ba-4b49-8fef-1023156f9863 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.225131 Nov 11 01:03:34.942089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 86/175] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:34 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:34.949123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:34.958748 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-628e2d32-008e-4ef9-a8a2-49b0bd5a2e0b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1553 microversion: 2.1 time: 0.232513 Nov 11 01:03:34.968589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 90/176] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:34 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:35.442241 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:35.443358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:35.450091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:35.450547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:35.451358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:35.451793 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:35.804224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a74769f7-f78b-4a2a-8884-19a140c37dda tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.366173 Nov 11 01:03:35.804857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 87/177] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:35 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:35.968655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:35.969262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:35.978423 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:35.979380 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:35.983031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:35.983031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:35.983587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:35.984015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:35.993396 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:35.996937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:35.998319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:35.998760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:36.288176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:36.295404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:36.300038 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5eb54dd5-126f-46c5-a86e-12773e9e9c85 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1553 microversion: 2.1 time: 0.325615 Nov 11 01:03:36.300774 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 88/178] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:35 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:36.306305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cafbbdfc-fb83-4c18-8071-38091bb7fe04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.352592 Nov 11 01:03:36.307146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 91/179] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:35 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:36.819808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:36.823117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:36.831503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:36.832182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:36.833121 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:36.833624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:36.974965 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2f5620f1-9c6a-497f-a70c-e84b66cddd5f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.163450 Nov 11 01:03:36.975830 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 89/180] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:36 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:37.209517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-15c486d1-82b9-4b3e-a31f-52b116d2d2c9 req-ed3a352c-a874-4fec-a10b-2c151f00ade2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0360cc95-5544-4fb1-bc22-e5597a623fc0", "name": "network-vif-deleted", "tag": "e550141e-b3f0-40cc-9ff5-80a4761a4f92"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:37.211391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:03:37.211391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:03:37.219845 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-15c486d1-82b9-4b3e-a31f-52b116d2d2c9 req-ed3a352c-a874-4fec-a10b-2c151f00ade2 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.220292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-15c486d1-82b9-4b3e-a31f-52b116d2d2c9 req-ed3a352c-a874-4fec-a10b-2c151f00ade2 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:37.231805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-15c486d1-82b9-4b3e-a31f-52b116d2d2c9 req-ed3a352c-a874-4fec-a10b-2c151f00ade2 service nova] Creating event network-vif-deleted:e550141e-b3f0-40cc-9ff5-80a4761a4f92 for instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 on hv-cinder-81708 Nov 11 01:03:37.251289 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-15c486d1-82b9-4b3e-a31f-52b116d2d2c9 req-ed3a352c-a874-4fec-a10b-2c151f00ade2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046265 Nov 11 01:03:37.251918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 92/181] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:03:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:03:37.326578 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:37.327621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:37.328441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:37.329329 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:37.337643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.338316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:37.339488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.340208 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:37.353786 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.354248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:37.355080 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.357625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:37.676245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:37.688528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4f187247-3320-479c-9c15-3cdc02cd72a4 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1345 microversion: 2.1 time: 0.374383 Nov 11 01:03:37.690667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 90/182] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:37 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1345 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:37.757326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:37.767384 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4bc4f4d9-dfa3-46fa-a9ed-3bfa571c7d76 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.444288 Nov 11 01:03:37.769663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 93/183] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:37 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:37.990541 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:37.991497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:37.997643 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.998318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:37.999160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:37.999589 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:38.156618 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c10780e4-4269-42de-a450-b4ea2c4cde5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.170576 Nov 11 01:03:38.157450 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 91/184] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:37 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:38.705723 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:38.707038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:38.714026 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:38.714386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:38.715183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:38.715628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:38.756594 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:38.757328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:38.757777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lazy-loading 'fault' on Instance uuid 0360cc95-5544-4fb1-bc22-e5597a623fc0 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:03:38.787700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:38.789112 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:38.796319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:38.797278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:38.798063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:38.798494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:38.813856 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39efe5377b14c469b09d6c88a3474f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf7efb5653647a882c13e0316a7ab68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:38.824925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-02578bef-c002-47cd-9ffb-59e5b5aafa27 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 200 len: 1350 microversion: 2.1 time: 0.122862 Nov 11 01:03:38.825508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 94/185] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:38 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:38.946155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:38.953410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-db0c797a-69a7-4fc2-afae-ff7033d9e72e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.170814 Nov 11 01:03:38.953976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 92/186] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:38 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:39.180603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:39.181666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:39.188173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.188681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.189473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.190477 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.362763 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-538094ce-f5bb-4f2c-b634-8745d31ec859 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.196712 Nov 11 01:03:39.363570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 95/187] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:39 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:39.841470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:39.842083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:39.848790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.849246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.850021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.850454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.863578 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] HTTP exception thrown: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. Nov 11 01:03:39.864167 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Returning 404 to user: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:03:39.864983 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f4b7aa55-1943-4664-9bcf-b1f7745f20da tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 404 len: 111 microversion: 2.1 time: 0.027429 Nov 11 01:03:39.865519 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 93/188] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:39 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:03:39.975609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:39.976778 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:39.988966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:39.989897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:39.991795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.992245 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.993033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.993465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.996169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.996813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:39.997649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:39.998089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:40.017039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] HTTP exception thrown: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. Nov 11 01:03:40.017616 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Returning 404 to user: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:03:40.027980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-28a7db7f-d2ee-4298-b408-14fe6dd18792 tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042786 Nov 11 01:03:40.029023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 94/189] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:03:39 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:03:40.254552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:40.266655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fd5c6dc8-ef88-4a38-a463-29089f230916 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.295301 Nov 11 01:03:40.267600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 96/190] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:39 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:40.380451 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:40.381529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:40.388324 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:40.394579 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:40.395685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:40.396353 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:40.618730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-98caeb9c-24d2-4a2c-b3d8-4e001c173d09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.247471 Nov 11 01:03:40.622079 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 95/191] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:40 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:40.736498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1581199094", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "232e5fb8-96bd-4e33-ad1f-50b0e7e803d2"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:41.285107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:41.286347 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:41.299017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.299017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.300154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.300732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.487628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:41.495153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-adb15ca7-be3d-4360-9d46-d4038db7c628 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.214681 Nov 11 01:03:41.495897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 96/192] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:41 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:41.510693 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:41.511287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:41.517037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.517553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.518986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.519473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.532893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] HTTP exception thrown: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. Nov 11 01:03:41.533665 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Returning 404 to user: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:03:41.534715 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8cf74887-7c51-4339-bafa-56d2d170bbaf tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 404 len: 111 microversion: 2.1 time: 0.027697 Nov 11 01:03:41.535364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 97/193] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:03:41 2021] DELETE /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:03:41.542934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:41.543764 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] [instance: 0360cc95-5544-4fb1-bc22-e5597a623fc0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:41.551495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.551626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.552416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.552850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.569920 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] HTTP exception thrown: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. Nov 11 01:03:41.570926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] Returning 404 to user: Instance 0360cc95-5544-4fb1-bc22-e5597a623fc0 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:03:41.571788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-135ec517-ded7-43c5-9a18-7c4ab64a5a3b tempest-DeleteServersTestJSON-1830722287 tempest-DeleteServersTestJSON-1830722287-project] 10.222.0.52 "GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0" status: 404 len: 111 microversion: 2.1 time: 0.032382 Nov 11 01:03:41.572340 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 98/194] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:41 2021] GET /compute/v2.1/servers/0360cc95-5544-4fb1-bc22-e5597a623fc0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 01:03:41.629197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:41.630122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:41.638020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.638770 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.639884 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:41.640500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:41.839455 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-14d3c14a-3eb0-4e0a-9f02-5be957fa56e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.213579 Nov 11 01:03:41.840349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 99/195] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:41 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:42.514143 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:42.514831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:42.521704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:42.522145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:42.522925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:42.523380 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:42.698269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:42.706162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dd26a699-a2a2-4e89-a5b4-170487750d46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.196516 Nov 11 01:03:42.706722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 100/196] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:42 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:42.850291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:42.851273 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:42.857609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:42.858063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:42.858832 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:42.859292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:43.012930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-56f53ccd-8574-4993-833b-f404a12d18c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 14 microversion: 2.20 time: 0.166549 Nov 11 01:03:43.013875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 101/197] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:42 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:43.725633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:43.726444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:43.734765 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:43.735230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:43.736047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:43.736541 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:43.878667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:43.886190 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c4cace0a-8612-48ca-b6cc-1b02923a313e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.165497 Nov 11 01:03:43.886692 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 102/198] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:43 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:03:44.027245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:44.028949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:44.038788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:44.039661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:44.040470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:44.041142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:48.259110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-411d3d83-1c09-4058-91b5-37155f3a6172 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 4372 microversion: 2.20 time: 4.236956 Nov 11 01:03:48.260452 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 103/199] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:44 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 4372 bytes in 4240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:03:48.266224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:48.268124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:48.277016 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:48.277462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:48.278329 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:48.279069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:48.425334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:48.432809 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-10686360-c1a1-424f-82a2-9921e8055b46 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.170860 Nov 11 01:03:48.433386 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 104/200] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:48 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:48.590183 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-665bc40a-d930-4c08-a5e1-8858fa20a29a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: .version_select at 0x7fd36435d040>, body: {"keypair": {"name": "tempest-keypair-184137629"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:48.615044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-665bc40a-d930-4c08-a5e1-8858fa20a29a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:03:48.618922 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-665bc40a-d930-4c08-a5e1-8858fa20a29a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for user fe12fd7b58fb46a79f92729e3ef7a105 and project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:03:48.832518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-665bc40a-d930-4c08-a5e1-8858fa20a29a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:03:48.836558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-665bc40a-d930-4c08-a5e1-8858fa20a29a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for user fe12fd7b58fb46a79f92729e3ef7a105 and project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:03:48.850278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-665bc40a-d930-4c08-a5e1-8858fa20a29a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.412066 Nov 11 01:03:48.851016 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 105/201] 10.222.0.52 () {60 vars in 1157 bytes} [Thu Nov 11 01:03:48 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:49.271582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:49.273307 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:49.279592 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:49.280041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:49.281341 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:49.282005 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:49.454831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2eee1831-2a52-4850-9073-1bc01d69d5c3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 8153 microversion: 2.20 time: 0.187549 Nov 11 01:03:49.457013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 106/202] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:49 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 8153 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:03:49.470793 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:03:49.471393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:49.478461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:49.479274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:49.480077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:49.480514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:49.738435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:03:49.753027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-051a1ad6-49b5-4298-8f7a-858603145d7b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.290550 Nov 11 01:03:49.756385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 107/203] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:03:49 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:03:50.467188 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:03:50.468170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:03:50.475349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:50.475808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:50.476589 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:03:50.477176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:03:50.633118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-657231ea-cef7-4db6-a610-69a9d53aa2ab tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 12499 microversion: 2.20 time: 0.169983 Nov 11 01:03:50.634060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 108/204] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:03:50 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 12499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:03:50.687441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2026909563", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0201e78f-31b0-4780-85e5-2d0c4a5203a2"}], "security_groups": [{"name": "tempest-securitygroup--812654174"}], "key_name": "tempest-keypair-184137629", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:14.065759 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] validate_networks() for [('232e5fb8-96bd-4e33-ad1f-50b0e7e803d2', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:04:14.181553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] validate_networks() for [('0201e78f-31b0-4780-85e5-2d0c4a5203a2', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:04:14.686645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:04:14.687229 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:04:14.687768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:04:14.688266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:04:14.688771 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:04:14.697703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.698222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.699142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.699648 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.717470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:04:14.722996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for user 325e6f2cc9e0420a8f09d879000375d3 and project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:04:14.735666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:04:14.738174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:04:14.782535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c0831ca8-ded5-477b-bb2f-96fa37ccfc9a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 34.050303 Nov 11 01:04:14.789179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 97/205] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:03:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 34052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 01:04:14.789179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:14.789179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:14.795717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.796162 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.796938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.797410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.808441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:04:14.808867 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:04:14.809339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:04:14.809747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:04:14.810250 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:04:14.819887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.820331 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.821128 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.821552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.855857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for project d65821f142fe445b8388094f872c5457. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:04:14.864448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for user fe12fd7b58fb46a79f92729e3ef7a105 and project d65821f142fe445b8388094f872c5457. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:04:14.876088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:04:14.879327 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:04:14.941734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:14.949069 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-35c06895-cdfe-4aea-9385-1f33f809a7c7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.163939 Nov 11 01:04:14.950023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b38eef58-5f89-4fdc-9bc6-d6d2cd2c6ed1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 24.267064 Nov 11 01:04:14.950666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 109/206] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:03:50 2021] POST /compute/v2.1/servers => generated 401 bytes in 24269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 01:04:14.957136 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 98/207] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:14 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:14.958336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:14.959341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:14.963178 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1212215565", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:14.966243 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.966688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:14.967660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:14.967973 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:15.041657 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] validate_networks() for None {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:04:15.144175 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a66d0e71-7968-4fb8-8b89-ef099de7268e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28468 microversion: 2.20 time: 0.190763 Nov 11 01:04:15.146087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 99/208] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:14 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:15.153041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-70a184b8-0152-4126-b5b5-a8ba5663ec21 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:15.154049 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-70a184b8-0152-4126-b5b5-a8ba5663ec21 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:15.253395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-70a184b8-0152-4126-b5b5-a8ba5663ec21 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:15.278235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-70a184b8-0152-4126-b5b5-a8ba5663ec21 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1218 microversion: 2.1 time: 0.130114 Nov 11 01:04:15.279486 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 100/209] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:15 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:15.284777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-debfc3e2-a984-4628-a801-6fc6ce9dcc4f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:15.285566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-debfc3e2-a984-4628-a801-6fc6ce9dcc4f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:15.381772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-debfc3e2-a984-4628-a801-6fc6ce9dcc4f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:15.388744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-debfc3e2-a984-4628-a801-6fc6ce9dcc4f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1237 microversion: 2.1 time: 0.107974 Nov 11 01:04:15.389404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 101/210] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:15 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:15.436625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:04:15.437126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:04:15.437995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:04:15.438399 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:04:15.438919 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:04:15.448260 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:15.448697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:15.449499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:15.449923 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:15.467733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Getting quotas for project a3ae2c2523374a969e98e2340346e184. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:04:15.472558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Getting quotas for user 98df5209d08a4653aae19309063defd4 and project a3ae2c2523374a969e98e2340346e184. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:04:15.483118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:04:15.485305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:04:15.536467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-023d7729-06a9-4dc1-a8c1-ef53bb9ba987 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576346 Nov 11 01:04:15.537284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 110/211] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:04:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:04:15.548742 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-82a95b36-cc13-4871-83ba-c8838632a487 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:15.549478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-82a95b36-cc13-4871-83ba-c8838632a487 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:15.630016 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-82a95b36-cc13-4871-83ba-c8838632a487 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:15.638233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-82a95b36-cc13-4871-83ba-c8838632a487 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1215 microversion: 2.1 time: 0.094726 Nov 11 01:04:15.648474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 102/212] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:15 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:15.968888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:15.969575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:15.978853 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:15.979322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:15.980086 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:15.980520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.118145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:16.125294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6edcd4d0-38ac-4fd7-9049-537eb13aa5bc tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.160067 Nov 11 01:04:16.125852 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 111/213] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:15 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:16.156903 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:16.157871 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:16.164381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.164831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.165603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.166043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.296636 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:16.297247 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:16.304214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.304688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.305470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.305909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.334503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-54a26d62-7484-425c-81a0-04ad1dd2a4e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28468 microversion: 2.20 time: 0.181201 Nov 11 01:04:16.338015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 103/214] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:16 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:16.367412 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:16.374685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-731599bb-fe97-4da9-815e-2c8c76494afc tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1270 microversion: 2.1 time: 0.081764 Nov 11 01:04:16.375275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 112/215] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:16 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:16.407542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:16.408331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:16.415091 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.415542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.416322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.416761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.484756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:16.494116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f6c151d7-b60d-4f4c-ba6d-f586f808d83c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1233 microversion: 2.1 time: 0.090146 Nov 11 01:04:16.495195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 104/216] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:16 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:16.656477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:16.657155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:16.667621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.668404 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.670755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:16.671827 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:16.761220 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:16.768687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a6ba7618-1a9f-46c4-92a5-a4f2e5115e64 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1211 microversion: 2.1 time: 0.116409 Nov 11 01:04:16.769265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 113/217] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:16 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:17.142997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:17.143898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:17.150190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.150633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.151431 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.151861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.346382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:17.347474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:17.351868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:17.360377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.361393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.362206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.362800 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.364912 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a586fbf8-79d8-4ffa-bb84-b37b1eb0931a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.226052 Nov 11 01:04:17.366124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 105/218] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:17 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:17.393371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:17.394685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:17.401920 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.402604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.403637 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.404212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.585283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-75c54ae2-dd73-4b3b-a78c-5c86c5eb9b6c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.243030 Nov 11 01:04:17.585949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 114/219] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:17 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:17.591047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:17.591745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:17.598501 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.598966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.599750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.600189 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.698325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:17.706200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5823c3fc-7180-4f8e-8986-bc126fd47292 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1295 microversion: 2.1 time: 0.119066 Nov 11 01:04:17.706918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 115/220] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:17 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1295 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:17.749574 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:17.757402 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-89f9a9a5-54b4-4ca1-b97e-49c2d3a28c47 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.368788 Nov 11 01:04:17.757976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 106/221] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:17 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:17.785987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:17.786922 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:17.793405 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.793857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.794641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:17.795276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:17.884459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:17.892968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-156713a7-70a5-4bb0-8aa1-ce8688e2cd73 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1267 microversion: 2.1 time: 0.111212 Nov 11 01:04:17.893540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 116/222] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:17 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:18.172324 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-a1522c5a-e61c-4aef-ba7b-b4c6c30a41fc req-6cd64f69-3adf-478f-ab9d-faf3a7102c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c78dbc5-446a-4880-b317-ba9b20304be9", "tag": "bcc3a1f2-10cd-4afa-a834-eb618cd1d74c"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:18.174897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:18.174897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:04:18.185565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-a1522c5a-e61c-4aef-ba7b-b4c6c30a41fc req-6cd64f69-3adf-478f-ab9d-faf3a7102c06 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.188839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-a1522c5a-e61c-4aef-ba7b-b4c6c30a41fc req-6cd64f69-3adf-478f-ab9d-faf3a7102c06 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.201105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-a1522c5a-e61c-4aef-ba7b-b4c6c30a41fc req-6cd64f69-3adf-478f-ab9d-faf3a7102c06 service nova] Creating event network-changed:bcc3a1f2-10cd-4afa-a834-eb618cd1d74c for instance 6c78dbc5-446a-4880-b317-ba9b20304be9 on hv-cinder-81708 Nov 11 01:04:18.208063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-a1522c5a-e61c-4aef-ba7b-b4c6c30a41fc req-6cd64f69-3adf-478f-ab9d-faf3a7102c06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040226 Nov 11 01:04:18.209815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 107/223] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:18.381687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:18.382430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:18.389812 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.390446 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.391418 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.392388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.587611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:18.596037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b3b9e935-dfc9-4808-bd91-eebe2e07019a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.218131 Nov 11 01:04:18.596933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:18.598515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:18.601308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 117/224] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:18 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:18.615907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.616610 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.618557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.619290 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.725050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:18.725996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:18.733406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.734132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.735546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.736150 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.800254 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bb4467d8-99fa-4cbe-8062-59aa1c35f3fc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.207074 Nov 11 01:04:18.805395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 108/225] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:18 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:18.811772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:18.812483 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:18.820980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.821626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:18.822571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:18.823219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.334529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:19.345813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-180b2332-f3dc-4b27-a549-3dac8fa96ae0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.625916 Nov 11 01:04:19.349292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:19.360072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 118/226] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:18 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:19.361911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0cbaac6a-9f7e-4493-a537-4692526afc82 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.554622 Nov 11 01:04:19.371337 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 109/227] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:18 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:19.371537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:19.371537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:19.371537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.371537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.371828 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.372482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.441393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:19.449161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1279cb1d-2636-4a20-8e22-aa5ca5b49d92 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1273 microversion: 2.1 time: 0.091449 Nov 11 01:04:19.450072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 119/228] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:19 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:19.616819 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:19.617480 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:19.626613 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.627703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.628493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.628922 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.771504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:19.782165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5839b875-3bcb-4387-a0dc-31b80563bd3b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.168916 Nov 11 01:04:19.784011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 110/229] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:19 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:19.813544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:19.815974 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:19.823845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.824616 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.825988 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.826883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.905659 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-3eb223a3-6de7-436a-96d6-74e40ad3125c req-13021830-c468-4ff3-b88e-af6153da4772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8", "tag": "7957db06-9b36-48fb-91f5-537bca5d85c5"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:19.907561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:19.907561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:04:19.915870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-3eb223a3-6de7-436a-96d6-74e40ad3125c req-13021830-c468-4ff3-b88e-af6153da4772 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:19.916434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-3eb223a3-6de7-436a-96d6-74e40ad3125c req-13021830-c468-4ff3-b88e-af6153da4772 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:19.929135 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-3eb223a3-6de7-436a-96d6-74e40ad3125c req-13021830-c468-4ff3-b88e-af6153da4772 service nova] Creating event network-changed:7957db06-9b36-48fb-91f5-537bca5d85c5 for instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 on hv-cinder-81708 Nov 11 01:04:19.934780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-3eb223a3-6de7-436a-96d6-74e40ad3125c req-13021830-c468-4ff3-b88e-af6153da4772 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032817 Nov 11 01:04:19.935648 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 111/230] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:20.142118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4b12a939-0f6d-4b5a-b583-0a80c9a39e53 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.333364 Nov 11 01:04:20.143094 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 120/231] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:19 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:20.370252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:20.371826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:20.379468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:20.380296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:20.387963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.388346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.388819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.389114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.389850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.390025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.390524 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.390636 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.709975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:20.713723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:20.721480 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-41f641cc-02ac-41ad-aa2e-2f395359bc89 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.354264 Nov 11 01:04:20.722192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 112/232] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:20 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:20.723790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-139a1535-b488-403c-9445-3e10b9891104 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.348407 Nov 11 01:04:20.733504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 121/233] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:20 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:20.735565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:20.736864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:20.742858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.743773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.744128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.744553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.799836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:20.800505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:20.806612 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.807091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.807907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:20.808402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:20.933198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:20.941295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0d912130-260d-4b86-b09a-fbfbab41fdaa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.211422 Nov 11 01:04:20.950304 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 113/234] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:20 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:20.981819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:20.989097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f56e1802-7ee0-4ee3-9e67-b4089b202bc2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1523 microversion: 2.1 time: 0.193338 Nov 11 01:04:20.989738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 122/235] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:20 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:21.156726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:21.157734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:21.164287 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.165071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.166114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.166832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.631711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4f0b99c2-f1c5-4ea5-89a0-4e8ee0e6cae4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.480270 Nov 11 01:04:21.635579 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 114/236] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:21 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:21.740011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:21.740621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:21.741498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:21.742188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:21.746497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.746980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.747759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.748235 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.748951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.749396 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.750625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.751107 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.954758 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:21.964703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b236a065-decc-4028-8e96-f650e10439b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.229933 Nov 11 01:04:21.975262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 123/237] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:21 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:21.975262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:21.975262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:21.984570 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.985159 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.986688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:21.987351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:21.998392 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:22.005906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3263c10e-d47f-444a-891a-2bcc53d32740 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.268201 Nov 11 01:04:22.015853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 115/238] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:21 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:22.020626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-28927b55-3d92-4e9d-abc6-f20aaf4a2a2c req-ff5eda7f-953f-4a3b-a1f0-bf97e677c2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b336841f-584a-488d-ae62-7c4887e8931c", "tag": "a71f9c2b-94e3-40dc-9a2a-efd4c7465094"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:22.022137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:22.022137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:04:22.029082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-28927b55-3d92-4e9d-abc6-f20aaf4a2a2c req-ff5eda7f-953f-4a3b-a1f0-bf97e677c2bd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.029520 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-28927b55-3d92-4e9d-abc6-f20aaf4a2a2c req-ff5eda7f-953f-4a3b-a1f0-bf97e677c2bd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.041287 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-28927b55-3d92-4e9d-abc6-f20aaf4a2a2c req-ff5eda7f-953f-4a3b-a1f0-bf97e677c2bd service nova] Creating event network-changed:a71f9c2b-94e3-40dc-9a2a-efd4c7465094 for instance b336841f-584a-488d-ae62-7c4887e8931c on hv-cinder-81708 Nov 11 01:04:22.046641 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-28927b55-3d92-4e9d-abc6-f20aaf4a2a2c req-ff5eda7f-953f-4a3b-a1f0-bf97e677c2bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029557 Nov 11 01:04:22.047296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 116/239] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:22.055811 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:22.056921 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:22.063976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.064587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.065383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.065816 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.173061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:22.180957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f34f55c3-44d4-447e-bbba-8c59de996d6b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.211558 Nov 11 01:04:22.181642 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 124/240] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:21 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:22.245099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:22.253163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7a6acc2f-1694-4608-b596-6dfbc021f351 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1503 microversion: 2.1 time: 0.203583 Nov 11 01:04:22.253740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 117/241] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:22 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:22.269557 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:22.270255 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:22.276120 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.276650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.277462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.278071 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.412307 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:22.419634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-92fed031-6c9d-4c13-90b6-345ddfda861a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1515 microversion: 2.1 time: 0.154465 Nov 11 01:04:22.420207 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 125/242] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:22 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:22.644473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:22.645513 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:22.652084 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.660307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.669995 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.669995 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.981531 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:22.982287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:22.989371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.989940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:22.990581 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:22.991059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.007054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fecec55e-d382-4bda-b8d0-a677accfe84a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.366977 Nov 11 01:04:23.010919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 118/243] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:22 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:23.034550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:23.036745 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:23.052007 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.055102 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.065733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.065889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.171937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:23.180623 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2a8d4d3d-cc32-43d4-9902-0521fab9fe71 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.202959 Nov 11 01:04:23.181242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 126/244] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:22 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:23.199504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:23.200136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:23.206219 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.206976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.207882 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.208433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.232972 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:23.241606 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d5f5d336-7146-4c93-adaa-498496201408 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.223704 Nov 11 01:04:23.242179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 119/245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:23 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:23.343262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:23.351113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f5e33381-da42-435c-92bc-283fb688932b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.155406 Nov 11 01:04:23.351682 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 127/246] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:23 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:23.793306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:23.794243 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:23.800468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.800918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.801680 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.802113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.824217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lazy-loading 'flavor' on Instance uuid 45620e84-de01-477d-a818-263dae68f119 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:04:23.894085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-178824bd-6bf3-4bd1-a0ec-d9403c799e73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action" status: 200 len: 32 microversion: 2.1 time: 0.104498 Nov 11 01:04:23.894685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 120/247] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:23 2021] POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action => generated 32 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:23.903502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:23.904293 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:23.911065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.911507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:23.912299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:23.912733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.020427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:24.022505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:24.029174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.029651 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.030629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.031095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.049134 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:24.056572 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8f786a0d-7e17-4898-9f75-565a183b4db2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.156621 Nov 11 01:04:24.057441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 128/248] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:23 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:24.189910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2bb70c81-9b01-4c41-afbe-16a43c9b2775 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.174517 Nov 11 01:04:24.195734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 121/249] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:24 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:24.197345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:24.197954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:24.203784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.206271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.207121 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.207552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.258577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:24.259224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:24.266265 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.267367 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.268099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.268490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.374181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:24.382349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b1eef872-22d1-4c34-a047-1f1a29893fad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.188714 Nov 11 01:04:24.392691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 129/250] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:24 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:24.397325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:24.397936 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:24.405555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.406011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.407132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:24.407417 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:24.441566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:24.450610 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-06692872-8032-4319-ad35-c6a368920c28 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.195955 Nov 11 01:04:24.451522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 122/251] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:24 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:24.544035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:24.554204 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4a26aaa1-b7f9-4ea2-99e8-440f31b0676a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.160393 Nov 11 01:04:24.554803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 130/252] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:24 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:25.075240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:25.075843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:25.085573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.086282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.087183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.087763 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.203734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:25.205504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:25.212123 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.212575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.213367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.213806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.278714 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:25.286972 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d4b83365-4202-41ca-b2e9-db5ca7f70ee2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.215412 Nov 11 01:04:25.291488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 123/253] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:25 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:25.375302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-81fef385-6446-44ff-94b7-20731ccb1ad7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.175286 Nov 11 01:04:25.376136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 131/254] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:25 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:25.399318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:25.400166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:25.406428 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.406872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.408369 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.408882 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.468494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:25.469384 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:25.476874 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.477428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.478211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.478638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.571386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:25.578436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-be704257-de7f-4331-89e4-cf54dc8433d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.182753 Nov 11 01:04:25.579028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 124/255] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:25 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:25.584691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:25.585284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:25.593162 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.593608 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.594383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:25.595004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:25.663442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:25.670889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9bac8089-5d15-4ba5-9a49-9cb73693498e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.206604 Nov 11 01:04:25.671600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 132/256] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:25 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:25.732761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:25.740566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7b647def-78dd-45c3-a211-1bf23ce5d4ce tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.159829 Nov 11 01:04:25.741194 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 125/257] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:25 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:26.304932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:26.305533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:26.312009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.312455 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.313241 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.314311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.390395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:26.392763 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:26.400235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.400953 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.401878 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.402450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.451829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:26.459601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ff00616f-be82-4d01-bd73-ae0680c107b2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.158212 Nov 11 01:04:26.460684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 133/258] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:26 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:26.590531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-236077f4-d988-4cf0-a8d2-5a704be4815c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.206190 Nov 11 01:04:26.591310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 126/259] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:26 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:26.596081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:26.597023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:26.603641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.604085 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.604872 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.605305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.689407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:26.690390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:26.697250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.697688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.699119 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.699225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.781948 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:26.791161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9f7b9907-a539-4a80-872c-b0aa58abae02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.198741 Nov 11 01:04:26.801549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 134/260] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:26 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:26.806214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:26.806816 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:26.812565 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.813002 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.815237 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:26.816019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:26.871464 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:26.881288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0cb6389e-fd50-42a4-9aa5-d2c6a6786be7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.196621 Nov 11 01:04:26.882085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 127/261] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:26 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:26.971046 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:26.978354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5306477b-32b8-4f7a-9e89-8b9584093dec tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.175634 Nov 11 01:04:26.978912 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 135/262] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:26 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:27.477438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:27.478044 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:27.484078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.484525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.485849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.486284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.602221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:27.604097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:27.612086 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.612862 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.614012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.614684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.669850 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:27.681150 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f523e2b8-c792-411f-b47d-cef84dd6e30f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.206812 Nov 11 01:04:27.691535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 128/263] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:27 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:27.752319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1c7c54ae-0c30-48df-9021-843de8fd3d1b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.153816 Nov 11 01:04:27.756361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 136/264] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:27 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:27.808852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:27.809455 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:27.815986 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.816429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.817205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.817641 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.899344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:27.900167 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:27.907028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.908187 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:27.909092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:27.909529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.004861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:28.012097 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b6c956aa-fa3a-4da3-a2a1-9cae08ebfd87 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.206967 Nov 11 01:04:28.012748 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 129/265] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:27 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:28.016923 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:28.017688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:28.023426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.023867 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.024640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.025073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.102144 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:28.109277 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5cb6d830-94f0-464e-9560-24a7f507aff6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.214919 Nov 11 01:04:28.110031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 137/266] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:27 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:28.167962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:28.175340 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f92f8909-bb3b-4203-a6ed-284c1579f40a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.161606 Nov 11 01:04:28.175900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 130/267] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:28 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:28.531907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-f41efd16-8b30-43f4-87bd-18c239c19d9f req-1f36db1b-f740-4844-b95b-732b8b5efc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c78dbc5-446a-4880-b317-ba9b20304be9", "name": "network-vif-plugged", "status": "completed", "tag": "bcc3a1f2-10cd-4afa-a834-eb618cd1d74c"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:28.533525 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:28.533525 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:04:28.541415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-f41efd16-8b30-43f4-87bd-18c239c19d9f req-1f36db1b-f740-4844-b95b-732b8b5efc24 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.541542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-f41efd16-8b30-43f4-87bd-18c239c19d9f req-1f36db1b-f740-4844-b95b-732b8b5efc24 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.555468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-f41efd16-8b30-43f4-87bd-18c239c19d9f req-1f36db1b-f740-4844-b95b-732b8b5efc24 service nova] Creating event network-vif-plugged:bcc3a1f2-10cd-4afa-a834-eb618cd1d74c for instance 6c78dbc5-446a-4880-b317-ba9b20304be9 on hv-cinder-81708 Nov 11 01:04:28.560088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-f41efd16-8b30-43f4-87bd-18c239c19d9f req-1f36db1b-f740-4844-b95b-732b8b5efc24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Nov 11 01:04:28.560857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 138/268] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:28.705291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:28.706469 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:28.713179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.714313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.719099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.719888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.769042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:28.771254 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:28.780597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.781733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.783106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:28.784132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:28.911006 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:28.918272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5ffb52e5-4a4d-454e-abdb-c4c5665bc0a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.217279 Nov 11 01:04:28.926046 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 131/269] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:28 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:28.992449 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7bf5f1d1-3971-44f6-845c-dee71f86cc56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.231320 Nov 11 01:04:28.993127 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 139/270] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:28 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:29.028602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:29.029235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:29.035053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.035511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.036280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.036715 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.127892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:29.128587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:29.135477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.136075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.137009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.137566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.273279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:29.281426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-83ecac4f-99a2-4696-99ae-ac79c45c8559 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.256388 Nov 11 01:04:29.282239 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 132/271] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:29 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:29.287053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:29.287661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:29.293366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.294197 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.295199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.295670 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.410439 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:29.418923 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-13743e9a-fd96-42a3-a339-a3f86d5146d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.296325 Nov 11 01:04:29.419738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 140/272] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:29 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:29.481983 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:29.489695 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0d426756-1102-42e2-ab70-8097f10095aa tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.206185 Nov 11 01:04:29.490269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 133/273] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:29 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:29.935786 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:29.936419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:29.944425 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.944981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:29.945897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:29.946409 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.004910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:30.006137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:30.013823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.014568 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.015619 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.016272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.099351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:30.106827 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-17caba8e-e9d6-47de-8ff6-f6483558b20b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.174808 Nov 11 01:04:30.107357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 141/274] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:29 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:30.162802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0eea4d0f-ea25-4140-afec-0f9c32f39530 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.161928 Nov 11 01:04:30.163491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 134/275] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:29 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:30.301506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:30.302370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:30.308959 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.309617 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.310398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.310832 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.437167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:30.438463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:30.455017 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.455847 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.456866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.457842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.527855 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:30.549644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4e8793cb-8fc3-4e5d-b3de-f881f4c2801f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.243313 Nov 11 01:04:30.550739 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 142/276] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:30 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:30.558466 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:30.559104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:30.567469 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.567930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.573461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.573988 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.720113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:30.730045 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e1d56eaa-ab71-45e7-b986-227b1a36c563 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1318 microversion: 2.1 time: 0.297704 Nov 11 01:04:30.731516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 135/277] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:30 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:30.742083 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-882d713e-d975-42d7-b94e-1597d5b9772f req-aef4cbc5-b81c-44cb-a574-8d6b3050afc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b336841f-584a-488d-ae62-7c4887e8931c", "name": "network-vif-plugged", "status": "completed", "tag": "a71f9c2b-94e3-40dc-9a2a-efd4c7465094"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:30.754158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:30.754158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:04:30.775962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-882d713e-d975-42d7-b94e-1597d5b9772f req-aef4cbc5-b81c-44cb-a574-8d6b3050afc4 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:30.776433 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-882d713e-d975-42d7-b94e-1597d5b9772f req-aef4cbc5-b81c-44cb-a574-8d6b3050afc4 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:30.790308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-882d713e-d975-42d7-b94e-1597d5b9772f req-aef4cbc5-b81c-44cb-a574-8d6b3050afc4 service nova] Creating event network-vif-plugged:a71f9c2b-94e3-40dc-9a2a-efd4c7465094 for instance b336841f-584a-488d-ae62-7c4887e8931c on hv-cinder-81708 Nov 11 01:04:30.795936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-882d713e-d975-42d7-b94e-1597d5b9772f req-aef4cbc5-b81c-44cb-a574-8d6b3050afc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062750 Nov 11 01:04:30.796546 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 136/278] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:30.801271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:30.809745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-48070d8b-011d-47a1-ac3a-6397fae2fa04 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.257935 Nov 11 01:04:30.810724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 143/279] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:30 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:31.129370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:31.130395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:31.136493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.136942 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.137900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.138494 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.176211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:31.177700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:31.185022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.185598 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.186379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.186813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.320749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:31.328486 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-10d907b8-b3b5-4b33-8ac4-2ce67fb3d480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.207322 Nov 11 01:04:31.329667 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 137/280] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:31 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:31.462000 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f7edcbfe-a493-4f53-a928-e3d3c158bf6e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28634 microversion: 2.20 time: 0.291823 Nov 11 01:04:31.462633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 144/281] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:31 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28634 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:31.567259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:31.567825 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:31.574044 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.574759 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.575594 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.576059 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.721153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:31.725998 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-64da40f4-cf33-41f4-9b52-c5ac982f80bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.163076 Nov 11 01:04:31.726609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 138/282] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:31 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:31.748462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:31.749169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:31.756191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.756639 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.757454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.757888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.827367 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:31.827992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:31.836025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.836919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.838080 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:31.838719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:31.973996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:31.984485 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bc756914-8df9-470a-b81e-e805f78123ca tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1508 microversion: 2.1 time: 0.239977 Nov 11 01:04:31.985944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 145/283] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:31 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:32.021806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d34a6feb-4cdb-45f6-8f8a-879eeea96bc7"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:32.023577 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:32.031380 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.032704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.033724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.034536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.077609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:32.085436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9e3b9701-395e-4510-b561-f4c4721e369a tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.262008 Nov 11 01:04:32.086003 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 139/284] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:31 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:32.143302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] HTTP exception thrown: Invalid volume: volume d34a6feb-4cdb-45f6-8f8a-879eeea96bc7 is already attached to instances: a61a1f6b-3738-404f-a57c-38c3e25aca4d Nov 11 01:04:32.143896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Returning 400 to user: Invalid volume: volume d34a6feb-4cdb-45f6-8f8a-879eeea96bc7 is already attached to instances: a61a1f6b-3738-404f-a57c-38c3e25aca4d {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:04:32.144720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d0b38a01-aeae-4f6b-a142-a6b9b5890e5e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.130599 Nov 11 01:04:32.145266 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 146/285] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:04:32 2021] POST /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 11 01:04:32.202435 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:32.202917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:32.209455 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.209908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.210702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.211173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.333078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'services' on Instance uuid a61a1f6b-3738-404f-a57c-38c3e25aca4d {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:04:32.346197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:32.346805 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:32.353582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.354031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.354804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.355271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.443659 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f6d2b98e-18d2-42dc-8a98-5977223fd3bf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments/d34a6feb-4cdb-45f6-8f8a-879eeea96bc7" status: 202 len: 0 microversion: 2.1 time: 0.244482 Nov 11 01:04:32.444259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 140/286] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:04:32 2021] DELETE /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments/d34a6feb-4cdb-45f6-8f8a-879eeea96bc7 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:32.452791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:32.454626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:32.460597 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.461045 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.461824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.462260 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.494189 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:32.502059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a8ede0e4-36e8-420c-b548-3cb31b60572b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.160079 Nov 11 01:04:32.502631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 147/287] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:32 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:32.504817 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2b3fc56d-5bf3-4984-82a9-88ca86e53ff8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056004 Nov 11 01:04:32.505543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 141/288] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:32 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:32.508962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:32.508962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:32.513971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.514418 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.515212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.515644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.715393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d7cf23ed-5fb6-400b-816a-b9e47efdf413 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 28793 microversion: 2.20 time: 0.211382 Nov 11 01:04:32.716174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 148/289] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:32 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 28793 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:32.744647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:32.745256 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:32.752187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.752635 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.753409 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.753841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.840431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-ac8f7661-4e13-495e-8a16-a292d6e92c6e req-d328f590-7dc0-4780-bd10-52fa957b7138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8", "name": "network-vif-plugged", "status": "completed", "tag": "7957db06-9b36-48fb-91f5-537bca5d85c5"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:32.842212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:32.842212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:04:32.851911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-ac8f7661-4e13-495e-8a16-a292d6e92c6e req-d328f590-7dc0-4780-bd10-52fa957b7138 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:32.852345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-ac8f7661-4e13-495e-8a16-a292d6e92c6e req-d328f590-7dc0-4780-bd10-52fa957b7138 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:32.864968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-ac8f7661-4e13-495e-8a16-a292d6e92c6e req-d328f590-7dc0-4780-bd10-52fa957b7138 service nova] Creating event network-vif-plugged:7957db06-9b36-48fb-91f5-537bca5d85c5 for instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 on hv-cinder-81708 Nov 11 01:04:32.870027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-ac8f7661-4e13-495e-8a16-a292d6e92c6e req-d328f590-7dc0-4780-bd10-52fa957b7138 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034017 Nov 11 01:04:32.870601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 149/290] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:32.888730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:32.896145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6658379b-67f0-4957-a6ec-0d68c74c10ce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.155183 Nov 11 01:04:32.896709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 142/291] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:32 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:33.104212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:33.105021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:33.113062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.113519 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.114294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.114732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.249680 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:33.257165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3a420091-b898-4a42-abb1-ffd1ed970ff1 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.157545 Nov 11 01:04:33.257836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 150/292] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:33 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:33.517232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:33.518202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:33.519150 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:33.520683 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:33.524746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.525316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.526110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.526543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.527679 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.528054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.528824 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.529258 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.558602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-90dce09c-a315-470f-a034-0dcd7e3d902a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046126 Nov 11 01:04:33.559197 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 143/293] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:33 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:33.667212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:33.674898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-11682a48-8887-44eb-b77f-5555239f7bb7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.160252 Nov 11 01:04:33.675482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 151/294] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:33 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:33.726429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:33.727402 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:33.733331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.733777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.734544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.735054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.913467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:33.914071 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:33.920319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.920774 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:33.921545 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:33.921982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.054848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:34.062423 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a9235c08-cb0f-45d0-9976-3a7d5fd313e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.152323 Nov 11 01:04:34.062989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 152/295] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:33 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:34.273145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:34.273742 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:34.282638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:34.283306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.284343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:34.284961 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.370097 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-047ac853-0299-41a4-8ea8-57ce48ffb20f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 29550 microversion: 2.20 time: 0.646884 Nov 11 01:04:34.371325 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 144/296] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:33 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 29550 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:34.459012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:34.467986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5cea3362-5480-44f7-8bd0-bea4c691898b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1315 microversion: 2.1 time: 0.198326 Nov 11 01:04:34.469277 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 153/297] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:34 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:34.571751 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:34.573023 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:34.581702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:34.582148 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.585715 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:34.587577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.624481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7dae9605-d1da-4022-b89f-95200997df8b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058266 Nov 11 01:04:34.625093 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 145/298] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:34 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:34.692217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:34.692822 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:34.698858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:34.699379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.700152 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:34.700575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:34.847026 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:34.854129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-71356919-02bd-4dd1-a237-aef27d10c365 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.166470 Nov 11 01:04:34.854758 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 154/299] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:34 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:35.080049 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:35.080716 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:35.086994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.087560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.088246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.088683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.223383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:35.230467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0c2ec437-1826-4e67-87c0-81ee58cf9a59 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.154716 Nov 11 01:04:35.231037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 146/300] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:35 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:35.382551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:35.383576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:35.389417 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.389868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.390639 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.391100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.485913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:35.486517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:35.492664 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.493105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.493869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.494298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.841274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:35.848919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-70ab9358-73cf-4447-ac58-f40a2d84183b tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1465 microversion: 2.1 time: 0.366794 Nov 11 01:04:35.849471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 147/301] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:35 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1465 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:35.853777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:35.854724 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:35.860776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.861470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.862241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.862700 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.892629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1992f514-f716-4065-a750-ccc49ba1edc6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Nov 11 01:04:35.893173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 148/302] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:35 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:35.897352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:35.897870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:35.903021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.903468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:35.904225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:35.904657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.029600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:36.037555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-20bf615c-d26f-4dad-9f48-598a201d114a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.143418 Nov 11 01:04:36.038114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 149/303] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:35 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:36.042311 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:36.042795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:36.049034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.049518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.050283 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.050716 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.074542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:04:36.152691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ad505359-8575-4e55-b2ae-4db9ecbd217e tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 204 len: 0 microversion: 2.1 time: 0.113332 Nov 11 01:04:36.153183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 150/304] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:04:36 2021] DELETE /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:04:36.161812 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:36.162507 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:36.167842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.168283 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.169050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.169481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.308241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:36.315559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-edda6a63-e97a-4c51-8010-ad7361f34ac4 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.157516 Nov 11 01:04:36.316117 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 151/305] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:36 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:36.321140 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:36.321876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:36.327322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.327783 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.328553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.329684 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.459362 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:36.467151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-41b68010-3cbd-4a91-a69d-9c3d33c55ecc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.149209 Nov 11 01:04:36.467791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 152/306] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:36 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:36.903512 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:36.904539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:36.910421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.910891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.911712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:36.912142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:36.941519 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a7d8c85b-b4d4-46f4-8236-7af72be07004 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041652 Nov 11 01:04:36.942042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 153/307] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:36 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:37.053874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:37.054484 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:37.060426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.060866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.061664 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.062097 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.190410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:37.199798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6bd86673-d4a6-4658-a695-a9ae5691b7c6 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.149450 Nov 11 01:04:37.200303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 154/308] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:37 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:37.332718 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:37.333627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:37.340252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.340701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.341479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.341913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.474060 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:37.481397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-74c6a46b-e2c9-4fc1-823e-92ddde2a2cf3 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.152534 Nov 11 01:04:37.481969 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 155/309] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:37 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:37.487304 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:37.487909 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:37.493508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.493958 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.495108 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.495550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.765805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:37.773783 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c92af7f9-9bf0-4c31-8874-c7cdbe8aa547 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.290884 Nov 11 01:04:37.774336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 156/310] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:37 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:37.953043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:37.954292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:37.960657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.961110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.962177 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:37.962618 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:37.996494 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-850a167a-38a2-45cd-8fcd-d2705fd844b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047059 Nov 11 01:04:37.996947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 157/311] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:37 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:38.217366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:38.217974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:38.224822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:38.225266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:38.226042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:38.226474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:38.359689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:38.367731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-829a7829-993f-42c4-b501-15dc7acc63a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.154396 Nov 11 01:04:38.368280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 158/312] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:38 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:38.498907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:38.499626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:38.505592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:38.506035 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:38.506809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:38.507264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:38.636103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:38.644144 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b921e0b0-9146-4cec-9b17-db35ccfde5be tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.148920 Nov 11 01:04:38.644705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 159/313] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:38 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:38.790550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:38.791909 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:38.797730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:38.798177 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:38.799499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:38.799960 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:38.931373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:38.938528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e470a997-f276-41b0-aad6-ae657e09c467 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.151589 Nov 11 01:04:38.939135 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 160/314] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:38 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:39.008745 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:39.009887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:39.015844 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.016288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.017063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.018158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.047547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ef5abd0c-5c3c-4306-857d-42aaeaec4e55 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Nov 11 01:04:39.048095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 161/315] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:39 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:39.384870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:39.385478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:39.391623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.392077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.392868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.393305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.525771 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:39.533915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e99ab729-4137-48d5-a2c6-fc1b719b7df7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.152087 Nov 11 01:04:39.534475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 162/316] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:39 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:39.661492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:39.662016 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:39.668032 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.668559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.669443 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.669875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.801813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:39.809655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e795a902-6453-48bf-bb52-ec6719cbcb87 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.152574 Nov 11 01:04:39.810219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 163/317] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:39 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:39.940680 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-80c1abdc-c484-4962-975e-caf0748374f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 32079 microversion: 2.20 time: 4.561528 Nov 11 01:04:39.941306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 155/318] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:35 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 32079 bytes in 4563 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:39.957029 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:39.957642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:39.963714 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.964538 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:39.965318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:39.965769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.059691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:40.060836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:40.068109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.068554 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.069331 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.069761 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.100467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:40.100959 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-722a6005-4dae-40a5-9d33-6734032ca9b0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Nov 11 01:04:40.101191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 156/319] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:40 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:40.107872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c4001c06-6317-4d25-8726-6727dc9dd334 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.155325 Nov 11 01:04:40.108589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 164/320] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:39 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:40.551472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:40.552088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:40.558327 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.558775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.559758 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.560277 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.706339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:40.714746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-89977a7c-4edc-416e-93de-b43654bc8d8a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.167256 Nov 11 01:04:40.715464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 157/321] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:40 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:40.827725 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:40.828234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:40.835468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.835924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.836712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.837139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.952335 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:40.953263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:40.965620 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.965992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.969579 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:40.970361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:40.991523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:40.999134 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e0216743-3d02-4583-a886-d6affac81c5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.175035 Nov 11 01:04:40.999711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 165/322] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:40 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:41.112275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:41.113789 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:41.119584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.119990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.120793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.121224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.150822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-75b4616d-e909-4a86-b0c0-f657c6c2940d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042536 Nov 11 01:04:41.151453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 166/323] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:04:41 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:04:41.155896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:41.156495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:41.166588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.166588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.166588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.166939 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.309744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:41.317238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e8f26972-beff-445b-868f-77a5be9c331e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1362 microversion: 2.1 time: 0.164750 Nov 11 01:04:41.317809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 167/324] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:41 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:41.360299 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1477798053", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "232e5fb8-96bd-4e33-ad1f-50b0e7e803d2"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:41.402767 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9617bd0f-d517-46a1-8091-67693637201c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 32330 microversion: 2.20 time: 0.453856 Nov 11 01:04:41.403453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 158/325] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:40 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 32330 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:41.411597 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] validate_networks() for [('232e5fb8-96bd-4e33-ad1f-50b0e7e803d2', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:04:41.775602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:41.776305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:41.786394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.787420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.788866 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.789522 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.899832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:04:41.900185 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:04:41.900647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:04:41.901049 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:04:41.901450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:04:41.912998 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.913438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.914255 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:41.914686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:41.933632 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:04:41.937963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for user 325e6f2cc9e0420a8f09d879000375d3 and project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:04:41.951475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:04:41.953802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:04:41.980801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:41.989839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f6d86d1e-6b3e-4571-accf-edb5e5c1233b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.227175 Nov 11 01:04:41.990600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 159/326] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:41 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:42.006270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-20db544d-fcb9-4d35-880b-933d1376053a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649448 Nov 11 01:04:42.011931 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 168/327] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:04:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 01:04:42.021781 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:42.022394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:42.022866 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5daf6268-18ca-4e46-8a65-66f1a28fbb4b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:42.024308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5daf6268-18ca-4e46-8a65-66f1a28fbb4b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:42.029395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.030022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.031337 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.031835 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.112378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5daf6268-18ca-4e46-8a65-66f1a28fbb4b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:42.120079 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5daf6268-18ca-4e46-8a65-66f1a28fbb4b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1218 microversion: 2.1 time: 0.106918 Nov 11 01:04:42.120873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 160/328] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:42 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:42.190038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:42.197744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1f43e650-5644-4d06-8700-d647cc15e9ca tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.181301 Nov 11 01:04:42.198482 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 169/329] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:42 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:42.334562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:42.335807 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:42.343559 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.344010 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.344825 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.345260 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.414215 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:42.415188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:42.421025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.421483 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.422269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.422705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.488991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:42.496379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2bf57dfc-ef80-44e2-b62c-8df7d3259394 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1548 microversion: 2.1 time: 0.166682 Nov 11 01:04:42.496949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 161/330] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:42 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:42.512675 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:42.513236 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:42.518872 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.519408 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.520142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:42.520565 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:42.602614 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2997a945-bc8c-4b95-8da0-407da84c27f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093420 Nov 11 01:04:42.603337 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 162/331] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Nov 11 01:04:42 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:04:42.665888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-94e31e7c-4407-45dc-bb79-a43e57c226e1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 32713 microversion: 2.20 time: 0.255275 Nov 11 01:04:42.670142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 170/332] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:42 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 32713 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:43.008357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:43.010211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:43.017007 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.017660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.018755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.019938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.138102 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:43.139113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:43.146513 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.146985 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.147766 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.148193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.261547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:43.271818 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1f65fa9a-441a-4f57-a0ef-c646a16ee44a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1270 microversion: 2.1 time: 0.137649 Nov 11 01:04:43.272405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 171/333] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:43 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:43.276964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:43.277571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:43.284042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.285167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.285957 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.286408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.322216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:43.329687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9e89abb3-9f19-4e31-8244-9edd026d51a8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.325090 Nov 11 01:04:43.330274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 163/334] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:43 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:43.529460 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:43.537301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-39acb334-1cd4-4c24-bce0-fdef6dd02ee0 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.263911 Nov 11 01:04:43.537904 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 172/335] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:43 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:43.677958 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:43.678880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:43.684985 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.685558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.686339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.686768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.792568 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:43.793498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:43.799749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.800698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.801523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.801961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.892315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0ca4931d-23d3-4e66-9952-18f0dd755dad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 33083 microversion: 2.20 time: 0.218235 Nov 11 01:04:43.896480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 164/336] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:43 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 33083 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:43.900367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-df900735-0e8d-41cc-999b-c783a32defe5 req-05cda5c1-1c2b-4339-9ac4-453aa34bf5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8", "tag": "7957db06-9b36-48fb-91f5-537bca5d85c5"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:43.902355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:43.902355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:04:43.914013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-df900735-0e8d-41cc-999b-c783a32defe5 req-05cda5c1-1c2b-4339-9ac4-453aa34bf5ac service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:43.914456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-df900735-0e8d-41cc-999b-c783a32defe5 req-05cda5c1-1c2b-4339-9ac4-453aa34bf5ac service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:43.928646 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-df900735-0e8d-41cc-999b-c783a32defe5 req-05cda5c1-1c2b-4339-9ac4-453aa34bf5ac service nova] Creating event network-changed:7957db06-9b36-48fb-91f5-537bca5d85c5 for instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 on hv-cinder-81708 Nov 11 01:04:43.933813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-df900735-0e8d-41cc-999b-c783a32defe5 req-05cda5c1-1c2b-4339-9ac4-453aa34bf5ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038162 Nov 11 01:04:43.934759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 165/337] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:44.288717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-522adfec-08b5-433d-926f-da3fe72b2fb7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.499515 Nov 11 01:04:44.289466 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 173/338] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:43 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:04:44.298367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:44.300160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:44.310898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.316177 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.317186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.317893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.348746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:44.349441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:44.359533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.364066 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.367448 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.368133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.429020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:44.437576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-963b98e4-9537-46ae-8d5f-68b1f3f713a4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1278 microversion: 2.1 time: 0.150719 Nov 11 01:04:44.438723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 166/339] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:44 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:44.558925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:44.560905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:44.572601 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:44.602543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ce2b3b58-63c6-4ad7-8fc9-0a5cfda35c07 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.256166 Nov 11 01:04:44.606353 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 174/340] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:44 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:44.607902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.608514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.615775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.616490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.889734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:44.898422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-730fde88-71d2-47a0-9d6e-a35ae8906698 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.348135 Nov 11 01:04:44.906727 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 167/341] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:44 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:44.907702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:44.908925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:44.915442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.923343 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:44.924531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:44.925221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.273599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-88caf57d-c025-4bc9-909f-cb8408395850 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 33550 microversion: 2.20 time: 0.370906 Nov 11 01:04:45.274291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 175/342] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:44 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 33550 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:45.304298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:45.305893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:45.314882 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.316006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.317500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.319029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.456852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:45.458905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:45.466161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.467017 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.468033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.468784 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.584466 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-597d50eb-ab74-4377-8dcd-4fba3568db6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.285617 Nov 11 01:04:45.585413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 168/343] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:45 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:45.593013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:45.605537 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5b683ebe-3827-402e-9917-7d54b5eecc2d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1276 microversion: 2.1 time: 0.151710 Nov 11 01:04:45.610824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 176/344] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:45 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:45.621914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:45.622738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:45.631291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.631759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.632577 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.633082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.793642 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:45.802124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e9084d59-3ce0-44b6-83fb-7687897f985a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.185078 Nov 11 01:04:45.802835 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 169/345] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:45 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:45.924338 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:45.925619 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:45.932065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.932785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:45.933658 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:45.934164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.153428 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:46.171122 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9b614cf3-6980-441b-b877-207c9805f346 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.247843 Nov 11 01:04:46.177886 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 177/346] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:45 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:46.286428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:46.287798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:46.295220 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.296098 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.297294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.297911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.578392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-df430528-e459-42cc-b0c4-94366fa56864 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 33990 microversion: 2.20 time: 0.296328 Nov 11 01:04:46.580064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 170/347] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:46 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 33990 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:46.595897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:46.597349 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:46.604502 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.604949 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.605735 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.606329 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.629568 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:46.630555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:46.641400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.648821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.649908 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.650495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.791223 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cd03fa8c-0537-4f88-96a5-3d4e0f46af28 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.198824 Nov 11 01:04:46.791870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 178/348] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:46 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:46.821188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:46.821893 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:46.829182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.829628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:46.830419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:46.830851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.136037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:47.144514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9a756086-71e8-4b28-ad40-dd60b8690c32 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.518912 Nov 11 01:04:47.152431 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:47.154209 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 171/349] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:46 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:47.160522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8509ff28-674c-47ff-b57e-898af54a76bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.343241 Nov 11 01:04:47.161800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 179/350] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:46 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:47.197158 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:47.199170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:47.208465 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.209770 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.210840 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.211427 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.411776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:47.420697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ea9305ae-3a32-41ba-b2f6-f5aa241caa44 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1471 microversion: 2.1 time: 0.230654 Nov 11 01:04:47.421745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 172/351] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:47 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:47.539766 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-de3f93df-88dd-4bd8-8f9b-52992a155f73 req-7d83f713-2f8f-4d77-b9c4-7ddfbb88f261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b336841f-584a-488d-ae62-7c4887e8931c", "name": "network-vif-deleted", "tag": "a71f9c2b-94e3-40dc-9a2a-efd4c7465094"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:47.544168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:47.544168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:04:47.559839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-de3f93df-88dd-4bd8-8f9b-52992a155f73 req-7d83f713-2f8f-4d77-b9c4-7ddfbb88f261 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.560593 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-de3f93df-88dd-4bd8-8f9b-52992a155f73 req-7d83f713-2f8f-4d77-b9c4-7ddfbb88f261 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.573722 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-de3f93df-88dd-4bd8-8f9b-52992a155f73 req-7d83f713-2f8f-4d77-b9c4-7ddfbb88f261 service nova] Creating event network-vif-deleted:a71f9c2b-94e3-40dc-9a2a-efd4c7465094 for instance b336841f-584a-488d-ae62-7c4887e8931c on hv-cinder-81708 Nov 11 01:04:47.580238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-de3f93df-88dd-4bd8-8f9b-52992a155f73 req-7d83f713-2f8f-4d77-b9c4-7ddfbb88f261 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049498 Nov 11 01:04:47.581250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 180/352] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:47.590933 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:47.591964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:47.598764 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.599630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.600945 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.601542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.802399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:47.803576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:47.811436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.811885 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.812675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:47.813105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:47.874837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-aae58194-fa01-45e5-a865-eaa33108566c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 34387 microversion: 2.20 time: 0.287838 Nov 11 01:04:47.875524 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 173/353] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:47 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 34387 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:48.043940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4248fb89-70cf-4f90-bc30-7813c16a502e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.245607 Nov 11 01:04:48.047298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 181/354] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:47 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:04:48.161996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:48.162700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:48.168907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.169356 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.170344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.170935 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.177965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:48.178670 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:48.189518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.190863 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.192242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.192924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.399734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:48.402930 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:48.407883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c4e1faff-3117-497d-af8c-e0cb41347048 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.249690 Nov 11 01:04:48.408731 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 174/355] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:48 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:48.415025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e27c656e-c35e-4d85-a1d7-d05c64209ba7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.241085 Nov 11 01:04:48.415614 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 182/356] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:48 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:48.438483 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:48.439358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:48.445473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.446172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.446978 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.447570 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.482922 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.483406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.483885 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lazy-loading 'fault' on Instance uuid b336841f-584a-488d-ae62-7c4887e8931c {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:04:48.531571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98df5209d08a4653aae19309063defd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ae2c2523374a969e98e2340346e184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:48.539217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9a1b9691-43e5-4872-90aa-fed9201e1e33 tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 200 len: 1305 microversion: 2.1 time: 0.104251 Nov 11 01:04:48.539788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 175/357] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:48 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:48.889103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:48.890028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:48.896773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.897219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:48.897992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:48.898422 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.052065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-39596c6c-569e-47bf-b108-caec21bc71af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 34890 microversion: 2.20 time: 0.166656 Nov 11 01:04:49.056590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 183/358] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:48 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 34890 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:49.056757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:49.056757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:49.062637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.063240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.064020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.064454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.222593 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4a5a7c66-970c-4440-98fb-9e132a97add5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.171888 Nov 11 01:04:49.224052 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 176/359] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:49 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:04:49.434279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:49.435315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:49.438046 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:49.439409 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:49.450887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.451534 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.452714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.453360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.454144 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.454596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.458494 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.459073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.678125 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:49.692500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-01574ce3-557b-41df-898e-ef72ce9fa2db tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.259139 Nov 11 01:04:49.705373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 177/360] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:49 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:49.712750 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:49.718652 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:49.719414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] [instance: b336841f-584a-488d-ae62-7c4887e8931c] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:49.724344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0a730c85-9dee-41f4-b7bb-4d0b80db1a7d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.294859 Nov 11 01:04:49.725264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 184/361] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:49 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:49.737295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.738493 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.739556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.740168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.756220 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] HTTP exception thrown: Instance b336841f-584a-488d-ae62-7c4887e8931c could not be found. Nov 11 01:04:49.756817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] Returning 404 to user: Instance b336841f-584a-488d-ae62-7c4887e8931c could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:04:49.757767 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0f2b958c-6ef0-42f5-b4bc-3d3159c10e5d tempest-VolumesNegativeTest-1783796305 tempest-VolumesNegativeTest-1783796305-project] 10.222.0.52 "GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c" status: 404 len: 111 microversion: 2.1 time: 0.050988 Nov 11 01:04:49.758328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 178/362] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:49 2021] GET /compute/v2.1/servers/b336841f-584a-488d-ae62-7c4887e8931c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:04:49.869075 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-5294e789-790a-43a9-9336-2b203599370b req-b2f623dc-f5bb-4402-baf5-86f4a1194fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea", "tag": "ff3dd580-7793-4eca-a64b-c7e41005425d"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:49.870625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:49.870625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:04:49.877914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-5294e789-790a-43a9-9336-2b203599370b req-b2f623dc-f5bb-4402-baf5-86f4a1194fcb service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:49.878645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-5294e789-790a-43a9-9336-2b203599370b req-b2f623dc-f5bb-4402-baf5-86f4a1194fcb service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:49.898898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-5294e789-790a-43a9-9336-2b203599370b req-b2f623dc-f5bb-4402-baf5-86f4a1194fcb service nova] Creating event network-changed:ff3dd580-7793-4eca-a64b-c7e41005425d for instance 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea on hv-cinder-81708 Nov 11 01:04:49.909058 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-5294e789-790a-43a9-9336-2b203599370b req-b2f623dc-f5bb-4402-baf5-86f4a1194fcb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043373 Nov 11 01:04:49.911608 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 185/363] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:50.069029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:50.070346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:50.079934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.080382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.082020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.082469 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.236511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:50.239087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:50.256581 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.257253 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.258362 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.259252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.262081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-383e8cff-64f5-4428-be1d-dc2bbd060171 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 35474 microversion: 2.20 time: 0.201211 Nov 11 01:04:50.273831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 179/364] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:50 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 35474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:04:50.540738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-79266dff-ae92-420a-a32b-0dfd9d999ca0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.301293 Nov 11 01:04:50.543309 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 186/365] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:50 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:04:50.710912 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:50.711642 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:50.730640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.731130 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.731925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.732402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.743601 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:50.744677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:50.761686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.762332 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:50.764454 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:50.767099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:51.064733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:51.067850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:51.075168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ae506cdc-d471-45ce-b473-ae43504c04ff tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.368889 Nov 11 01:04:51.079032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 180/366] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:50 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:51.087942 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a9f8757d-7c67-4823-9bba-f70eec564818 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.343247 Nov 11 01:04:51.093572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 187/367] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:50 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:51.283773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:51.284740 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:51.292883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:51.293670 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:51.294827 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:51.295642 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:51.520047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b555ea20-64b1-4179-9bbf-7d1dab9b00d6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 36018 microversion: 2.20 time: 0.239822 Nov 11 01:04:51.520888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 181/368] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:51 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 36018 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:51.553345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:51.554270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:51.560646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:51.561096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:51.561888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:51.562448 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:51.703576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d02f8130-0f91-401c-98ed-812e590339b5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.154840 Nov 11 01:04:51.704558 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 188/369] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:51 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:52.100851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:52.101530 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:52.105013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:52.105723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:52.119069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.119851 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.125074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.125530 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.126367 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.126655 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.126795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.127478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.563674 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:52.573995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f5bdaec5-0e0a-42d2-ba1b-8ccfdb139680 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.481515 Nov 11 01:04:52.583592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:52.590863 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 182/370] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:52 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:52.593738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-078ce561-fa4d-4ff9-b9d6-048a0f96f85b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.497354 Nov 11 01:04:52.603372 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 189/371] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:52 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:52.603714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:52.603714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:52.612974 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.613940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.628824 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.629695 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.715762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:52.716890 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:52.728677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.729297 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.730116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:52.730741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:52.877121 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fa80ca29-9d6c-4842-b786-837a11cb29ec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 36728 microversion: 2.20 time: 0.288820 Nov 11 01:04:52.885128 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 183/372] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:52 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 36728 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:52.931024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-13d4bce2-96d1-499a-8a83-e8360defa891 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.219339 Nov 11 01:04:52.931666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 190/373] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:52 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:53.594093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:53.595383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:53.603227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:53.603661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:53.604443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:53.605026 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:53.611781 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:53.613598 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:53.622639 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:53.623124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:53.623929 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:53.624592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:53.975924 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:53.987719 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e4160109-ed63-4ae2-9d21-f16ea2c3f93e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.397116 Nov 11 01:04:53.989460 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 184/374] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:53 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:53.989565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:53.996558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:53.997174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-98945036-c047-44b0-b120-da219bcc1b12 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.389832 Nov 11 01:04:53.998211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:54.009317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:54.009763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:54.010889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:54.011068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 191/375] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:53 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:54.011658 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:54.017798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:54.022734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:54.029587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:54.030278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:54.036027 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:54.036686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:54.215567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8671b6f6-c653-4eec-9fe6-c1a795157f2e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 37115 microversion: 2.20 time: 0.223310 Nov 11 01:04:54.220237 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 185/376] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:53 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 37115 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:54.241316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ded1d812-9a6a-4c62-b645-61ee0efad97f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.229009 Nov 11 01:04:54.242006 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 192/377] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:54 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:54.845100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-8b7bf886-27f7-41af-9282-55ebbe82743c req-19477f7c-e4fe-490e-93c3-6d4f8215368b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea", "name": "network-vif-plugged", "status": "completed", "tag": "ff3dd580-7793-4eca-a64b-c7e41005425d"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:54.850088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:04:54.850088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:04:54.864478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-8b7bf886-27f7-41af-9282-55ebbe82743c req-19477f7c-e4fe-490e-93c3-6d4f8215368b service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:54.865004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-8b7bf886-27f7-41af-9282-55ebbe82743c req-19477f7c-e4fe-490e-93c3-6d4f8215368b service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:54.889338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-8b7bf886-27f7-41af-9282-55ebbe82743c req-19477f7c-e4fe-490e-93c3-6d4f8215368b service nova] Creating event network-vif-plugged:ff3dd580-7793-4eca-a64b-c7e41005425d for instance 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea on hv-cinder-81708 Nov 11 01:04:54.898531 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-8b7bf886-27f7-41af-9282-55ebbe82743c req-19477f7c-e4fe-490e-93c3-6d4f8215368b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057877 Nov 11 01:04:54.900057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 186/378] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:04:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:04:55.008353 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:55.010191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:55.019165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.020160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.020509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:55.021393 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.021959 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.022683 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:55.034921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.036347 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.037410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.038063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.323680 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:55.331944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:55.351434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f1559395-f143-45ca-a984-3d52772d9ad9 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.348757 Nov 11 01:04:55.353396 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 193/379] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:55 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:55.357226 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9cac1af4-04a6-46f5-87e0-205aa3a9c7be tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.342453 Nov 11 01:04:55.361260 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 187/380] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:55 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:55.365583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:55.366780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:55.371165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:55.375167 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:55.375562 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.376352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.379129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.380163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.388587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.389440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:55.390436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:55.391144 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.008091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-598a4070-9bfa-419d-b183-1d9e86cf6c4a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.644985 Nov 11 01:04:56.012216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 188/381] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:55 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:56.087356 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e8196363-ff6f-49b6-b107-43e4ae241f4e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 200 len: 38047 microversion: 2.20 time: 0.731241 Nov 11 01:04:56.089653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 194/382] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:55 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 38047 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:04:56.102215 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:56.103285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:56.113184 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:56.114085 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.115934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:56.116453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.152231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-68127130-a91e-42e0-b56a-dd897c4aa3e7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/ips" status: 200 len: 151 microversion: 2.20 time: 0.056227 Nov 11 01:04:56.154034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 189/383] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Nov 11 01:04:56 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:04:56.392547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:56.393217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:56.399915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:56.400691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:56.435644 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:56.437930 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.438925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:56.439464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.440628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:56.441448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:56.441893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.442642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:56.977666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:56.989203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e568ea1b-d6f6-44a4-91e8-3b65694c3d16 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.611930 Nov 11 01:04:56.999093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 190/384] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:56 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:57.007507 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:57.016222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-79ed06e8-f52e-4e23-8697-f2ae85bb55fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1318 microversion: 2.1 time: 0.643184 Nov 11 01:04:57.025243 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:57.028316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 195/385] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:56 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1318 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:57.028763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:57.039028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:57.040095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:57.041073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:57.041669 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:57.202876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-46a3e1af-29f0-4a07-ba46-ca2257c09164 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.184722 Nov 11 01:04:57.204174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 191/386] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:57 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:58.009055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:58.009683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:58.017801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:58.024884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:58.026203 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:58.026660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:58.037404 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:04:58.038110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:58.060875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:58.061551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:58.062726 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:58.063744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:58.676278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:58.680447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:04:58.711565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6e9d9670-d0c5-460c-b935-59e8266200ba tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.706538 Nov 11 01:04:58.712271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e8edca4a-11f4-447d-bdd3-a17a220233eb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1509 microversion: 2.1 time: 0.678627 Nov 11 01:04:58.712837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 192/387] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:58 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1509 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:04:58.713286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 196/388] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:04:58 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:04:58.742309 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:58.744300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:58.762412 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:58.764455 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:58.771994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:58.772596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:58.949275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-05b5278a-c82c-432e-a6be-b0953e8e02a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.234167 Nov 11 01:04:58.949937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 197/389] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:04:58 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:04:59.244181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1393069937", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "a2a7ef17-53bb-4307-9d1e-6ba2e00cf3fa"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:59.366597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] validate_networks() for [('a2a7ef17-53bb-4307-9d1e-6ba2e00cf3fa', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:04:59.613955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:04:59.616502 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:04:59.629345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:59.631304 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:59.632934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:04:59.634933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:04:59.698244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lazy-loading 'flavor' on Instance uuid c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:04:59.992760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:04:59.993186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:04:59.993664 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:04:59.994075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:04:59.995037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:05:00.005600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.006289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.008191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.016371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.048934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Getting quotas for project 53f9822d826e47279ba9ce7297752c6e. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:05:00.058218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Getting quotas for user 11909fcae757416d88e258fb42f1859d and project 53f9822d826e47279ba9ce7297752c6e. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:05:00.110282 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:05:00.117932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:05:00.218879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3cb6c96a-8ef2-422c-aaa7-1861caae7882 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985696 Nov 11 01:05:00.219938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 193/390] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:04:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:05:00.236438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:00.239258 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:00.261839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-15bdb099-6473-45a1-b07d-d91c3f83d321 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 202 len: 0 microversion: 2.20 time: 0.639830 Nov 11 01:05:00.290434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 198/391] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:04:59 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:05:00.295546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.301198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.311272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.312713 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.345213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:00.348910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:00.357984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.359034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.360103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.360911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.585444 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b7a0b70d-1dbc-4bbd-a18c-a28516578529 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.290491 Nov 11 01:05:00.586080 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 199/392] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:00 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:00.592386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-be373dfd-aaab-4ca9-9393-3ca47de23560 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:00.595521 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-be373dfd-aaab-4ca9-9393-3ca47de23560 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:00.761546 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-be373dfd-aaab-4ca9-9393-3ca47de23560 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:00.776205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-be373dfd-aaab-4ca9-9393-3ca47de23560 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1219 microversion: 2.1 time: 0.187916 Nov 11 01:05:00.776832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 200/393] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:00 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:00.791506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:00.793747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:00.802625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:00.802778 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.803744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.804774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.805441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.814649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d95b0959-71c8-4858-a55d-6aee90c71c73 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.593576 Nov 11 01:05:00.816696 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 194/394] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:00 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:00.822705 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b3d434-62a2-4042-a7ae-4b41576871df"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:00.824684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:00.834850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.835657 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:00.836957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:00.837595 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:01.024394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:01.036876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:01.039276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:01.041091 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8974a325-2fe6-4d4c-b11d-6341c74141a8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.254025 Nov 11 01:05:01.042185 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 201/395] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:00 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:01.386599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2ce0cb4c-8429-4b08-b157-30d9ca449d50 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568365 Nov 11 01:05:01.387220 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 195/396] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:05:00 2021] POST /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:01.597418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:01.598409 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:01.615125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:01.615600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:01.616397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:01.616839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:01.793992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:01.795126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:01.804639 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:01.809160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:01.810244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:01.811662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:01.915569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e39cd4f3-776f-4867-b0e6-2eb852c8ba86 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.322748 Nov 11 01:05:01.926563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 202/397] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:01 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:01.926563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:01.926563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:01.954124 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:01.962479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:01.973432 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:01.974039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:02.002666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:02.010567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a1d24c2e-87dd-48d5-b6b3-64852ce9a572 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1271 microversion: 2.1 time: 0.221521 Nov 11 01:05:02.011172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 196/398] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:01 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:02.065380 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:02.066263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:02.073873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:02.080270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:02.082089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:02.084897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:02.181844 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:02.190204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-00bd686b-9f57-4010-9964-4c63d4e988fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.271818 Nov 11 01:05:02.191189 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 203/399] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:01 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:02.390039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:02.409925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:02.411505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:02.412693 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ee728389-83e3-497a-89a6-8e59936e56f4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.352023 Nov 11 01:05:02.413418 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 197/400] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:02 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:02.484515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b1e17c96-c6e0-4997-b19c-466831ef193e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Action: 'create', calling method: .version_select at 0x7fd364377b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1852709330"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:02.511262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-b1e17c96-c6e0-4997-b19c-466831ef193e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Getting quotas for project 5dff1f2fb612458e95b9346b3d29040d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:05:02.516110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-b1e17c96-c6e0-4997-b19c-466831ef193e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Getting quotas for user 92d2b8de9b734a48957f0aed750617f2 and project 5dff1f2fb612458e95b9346b3d29040d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:05:02.926211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:02.928381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:02.938653 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:02.939478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:02.941090 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:02.941887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.123947 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-626cf107-cf5b-477a-9921-c3fffd22e8b4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.201231 Nov 11 01:05:03.127915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 198/401] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:02 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:05:03.133796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:03.134804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:03.146744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:03.147222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.148012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:03.148455 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.312841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-b1e17c96-c6e0-4997-b19c-466831ef193e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Getting quotas for project 5dff1f2fb612458e95b9346b3d29040d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:05:03.318985 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-b1e17c96-c6e0-4997-b19c-466831ef193e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Getting quotas for user 92d2b8de9b734a48957f0aed750617f2 and project 5dff1f2fb612458e95b9346b3d29040d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:05:03.337219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b1e17c96-c6e0-4997-b19c-466831ef193e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.142909 Nov 11 01:05:03.338429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 204/402] 10.222.0.52 () {60 vars in 1157 bytes} [Thu Nov 11 01:05:02 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:03.343428 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:03.344103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:03.352782 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:03.353566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.354551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:03.355361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.371631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:03.379304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e660a690-7732-498e-aad3-369902b3f9a6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1277 microversion: 2.1 time: 0.249567 Nov 11 01:05:03.380290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 199/403] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:03 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:03.436413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:03.441687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:03.455470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:03.458057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.459136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:03.461384 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:03.508633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:03.519141 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-960ea150-c118-42a0-a5be-5e7f84e10a3d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.179814 Nov 11 01:05:03.519724 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 205/404] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:03 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:03.636750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:03.645126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:03.646635 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:03.660000 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-95ec5abb-41a4-4597-a135-d788652d0f6d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.232387 Nov 11 01:05:03.660897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 200/405] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:03 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:04.136478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:04.137659 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:04.144656 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.145444 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.146238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.146828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.399603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:04.400537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:04.407044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.407760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.409706 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.410366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.620453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:04.631701 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c10cebbf-628c-4342-a6b9-1f1f7a390597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.236058 Nov 11 01:05:04.632707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 201/406] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:04 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:04.637933 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:04.638956 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:04.651641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.652447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.653779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.654787 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.874222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:04.885013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-52554c2f-ca7e-4117-938c-a1045a672540 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.250818 Nov 11 01:05:04.886313 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 202/407] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:04 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:04.897651 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:04.898370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:04.904869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.905560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:04.906471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:04.907064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:05.077560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:05.088566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:05.091333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:05.093001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f190ac90-0609-44e3-802d-f54872021eb1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.205405 Nov 11 01:05:05.093737 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 203/408] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:04 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:05.650524 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:05.651237 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:05.657224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:05.657669 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:05.658567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:05.660173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:05.807730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:05.816415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-952ef90f-57e3-44db-9db5-5c613e9a074c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.169397 Nov 11 01:05:05.817003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 204/409] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:05 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:05.905376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:05.906034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:05.913467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:05.913911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:05.914695 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:05.915151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:06.057724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:06.065409 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1839c561-5625-4072-a535-1e40199abf36 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.163675 Nov 11 01:05:06.065984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 205/410] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:05 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:06.114312 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:06.114919 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:06.121061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:06.121507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:06.122289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:06.122723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:06.256576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:06.265976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:06.267747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:06.269573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c55779fb-704c-4ad8-9f32-1399d159aa7b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.159852 Nov 11 01:05:06.270459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 206/411] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:06 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:06.834175 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:06.835104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:06.841773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:06.842344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:06.843420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:06.844018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:06.990137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:06.997559 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f8846106-37fb-4532-b692-f6e2e7615fa0 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.168443 Nov 11 01:05:06.998113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 207/412] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:06 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:07.081289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:07.081821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:07.087938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:07.088394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:07.089471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:07.089911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:07.221930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:07.229723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c8853517-d3e8-4f6c-b11d-cffce898101c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.152182 Nov 11 01:05:07.230284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 208/413] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:07 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:07.287269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:07.287902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:07.293678 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:07.294127 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:07.294902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:07.295362 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:07.380974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fbb94f6c-f6af-4f34-af00-639f9ceb31fb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 3.248901 Nov 11 01:05:07.385518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 206/414] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:04 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 3254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:07.457277 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:07.465729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:07.467281 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:07.468516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9d255b8b-4b11-41a1-9bab-34fc34d1746b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.185303 Nov 11 01:05:07.469107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 209/415] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:07 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:07.914583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-c9dd75ef-a8cc-4952-a181-002dd3053700 req-9dd56873-a450-442f-b5d0-5cf78986e50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf1d23b-4934-4920-b304-0958f87dd3c5", "tag": "d6b56662-d64b-46ed-a321-18629bfb4927"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:07.916088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:05:07.916088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:05:07.923696 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-c9dd75ef-a8cc-4952-a181-002dd3053700 req-9dd56873-a450-442f-b5d0-5cf78986e50a service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:07.924179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-c9dd75ef-a8cc-4952-a181-002dd3053700 req-9dd56873-a450-442f-b5d0-5cf78986e50a service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:07.942376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-c9dd75ef-a8cc-4952-a181-002dd3053700 req-9dd56873-a450-442f-b5d0-5cf78986e50a service nova] Creating event network-changed:d6b56662-d64b-46ed-a321-18629bfb4927 for instance 7cf1d23b-4934-4920-b304-0958f87dd3c5 on hv-cinder-81708 Nov 11 01:05:07.950345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-c9dd75ef-a8cc-4952-a181-002dd3053700 req-9dd56873-a450-442f-b5d0-5cf78986e50a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039578 Nov 11 01:05:07.953470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 207/416] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:05:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:08.014521 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:08.015240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:08.024441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.025044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.026060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.026495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.167134 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:08.174364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6c2c47c9-11ec-4885-87e8-72e26460c248 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.163372 Nov 11 01:05:08.175083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 210/417] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:08 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:08.247746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:08.248439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:08.255462 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.255911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.256819 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.257283 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.392942 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:08.394632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:08.399384 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:08.400921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.401380 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.402173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.402612 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.407833 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-710da5db-c32d-4664-95e4-13ca77eb1c6a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.164053 Nov 11 01:05:08.410662 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 208/418] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:08 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:08.487405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:08.488014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:08.494739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.495214 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.496008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:08.496445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:08.632808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:08.640470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:08.641961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:08.643255 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-58ae4b59-2ca5-4ee8-bc68-6f9225e8dfe8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.160002 Nov 11 01:05:08.643822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 209/419] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:08 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:09.045135 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7e033e4a-d675-49cd-86f2-c19f1e7797ee tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.656122 Nov 11 01:05:09.045788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 211/420] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:08 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:05:09.190983 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:09.191580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:09.197807 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:09.198248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:09.199049 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:09.199481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:09.335213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:09.343573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-61dbea47-2e8e-46fc-ad5a-ca4fec07e3a9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.156372 Nov 11 01:05:09.344143 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 210/421] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:09 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:09.424553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:09.425295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:09.432264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:09.432736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:09.433517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:09.433948 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:09.581184 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:09.588530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4b6c62c8-6d3a-4e68-9e34-b44dfeb9a7a4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.168039 Nov 11 01:05:09.589098 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 212/422] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:09 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:09.661981 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:09.662619 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:09.668500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:09.668950 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:09.669737 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:09.670177 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:09.802800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:09.810602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:09.812181 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:09.813422 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-996bcbc2-f5b2-4044-8409-02f6e6ef56c1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.155838 Nov 11 01:05:09.814092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 211/423] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:09 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:10.059083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:10.060074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:10.066648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.067142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.067915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.068349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.324673 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-32917204-633f-4551-af17-6f1b7240fc18 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.271874 Nov 11 01:05:10.325351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 213/424] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:10 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:10.360940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:10.361703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:10.368264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.368748 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.369559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.370024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.500677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:10.509488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-110d09a0-fb5e-4a96-8083-b0ceaa6e5247 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.152853 Nov 11 01:05:10.510067 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 212/425] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:10 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:10.605771 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:10.606462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:10.613429 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.613877 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.614652 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.615118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.760504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:10.768398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f267dd48-dde5-447c-a2a2-77f3b3e77121 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.165889 Nov 11 01:05:10.768803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 214/426] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:10 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:10.831996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:10.832585 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:10.838868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.839606 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.840368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:10.840834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:10.972154 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:10.980561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:10.982069 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:10.983258 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-63f347b9-4c2a-4756-8ca1-5472271fce6f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.155467 Nov 11 01:05:10.983818 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 213/427] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:10 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:11.336206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:11.337122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:11.344160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.344606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.345384 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.345876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.503464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3d54e0c3-7b14-42fe-a4a3-357112651040 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.170923 Nov 11 01:05:11.504479 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 215/428] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:11 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:11.528349 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:11.529036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:11.535897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.536322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.537087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.537515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.689013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:11.696836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2f738ef4-d825-4f33-aaf4-f920d10e14a1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.172701 Nov 11 01:05:11.697405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 214/429] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:11 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:11.786242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:11.787504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:11.795484 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.795921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.796950 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.797961 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.953185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:11.961632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-957c2fff-94ce-4fd9-a32e-8ef86d12212f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1501 microversion: 2.1 time: 0.180633 Nov 11 01:05:11.962187 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 216/430] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:11 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:11.979280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edbac7d9-033c-4075-8470-f1e5b3a6c110"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:11.980468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:11.986627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.987634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:11.988404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:11.988834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.000276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:12.000919 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:12.007631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.008073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.008850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.009282 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.014676 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] HTTP exception thrown: Cannot 'attach_volume' instance 45620e84-de01-477d-a818-263dae68f119 while it is in vm_state rescued Nov 11 01:05:12.015292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Returning 409 to user: Cannot 'attach_volume' instance 45620e84-de01-477d-a818-263dae68f119 while it is in vm_state rescued {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:05:12.016108 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c92d6fb5-8fcd-4363-bcf7-c9ef28b71bb8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040890 Nov 11 01:05:12.016840 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 215/431] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:05:11 2021] POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 11 01:05:12.025721 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:12.026244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:12.031956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.032399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.033302 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.033761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.105021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2118b74c-20cf-4beb-be60-9fb7a584f77e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action" status: 202 len: 0 microversion: 2.1 time: 0.082411 Nov 11 01:05:12.108945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 216/432] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:12 2021] POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:05:12.114814 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:12.115550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:12.122316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.122997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.123577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.124005 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.161138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:12.169180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:12.170691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:12.172113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7604c019-96d4-47b0-8dbb-30fcdbae2295 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.175527 Nov 11 01:05:12.172728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 217/433] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:11 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:12.262011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:12.270557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c3b20485-089f-4c73-be54-65dd1683f231 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.160213 Nov 11 01:05:12.271106 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 217/434] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:12 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:12.513481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:12.514395 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:12.521199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.521645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.522419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.522855 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.713442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:12.714420 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:12.721879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.722331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.723119 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:12.723548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:12.727094 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9f2f93e4-95df-4d2c-9c4c-ba39e99ec049 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 14 microversion: 2.1 time: 0.217048 Nov 11 01:05:12.728057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 218/435] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:12 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 14 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:12.860822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:12.868091 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2bea0e82-f7a4-48d2-9a78-c3d096433b04 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.158322 Nov 11 01:05:12.868662 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 218/436] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:12 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:13.196026 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:13.196724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:13.206445 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.206895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.207758 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.208349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.287936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:13.289263 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:13.296884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.297355 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.298330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.299394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.410694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:13.420631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:13.422227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:13.423495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6a7935ea-4c39-46d2-be59-c9a1e9a785d3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.235436 Nov 11 01:05:13.425146 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 219/437] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:13 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:13.477897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:13.485809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c5a97f55-4236-4b81-a168-1b2597131f62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.202567 Nov 11 01:05:13.487237 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 219/438] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:13 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:13.739335 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:13.740399 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:13.747230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.747819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.748676 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.749143 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.884362 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:13.884965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:13.890678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.891166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.891932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:13.892355 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:13.948551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bc7702d1-849a-43fe-bf68-233d27974c03 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 2021 microversion: 2.1 time: 0.213856 Nov 11 01:05:13.951856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 220/439] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:13 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 2021 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:14.030010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:14.037970 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8feca394-c456-49f1-8bc2-f6aefd423fe1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.157278 Nov 11 01:05:14.038544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 220/440] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:13 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:14.444485 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:14.445166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:14.452082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:14.452526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:14.453297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:14.453729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:14.505908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:14.506439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:14.512314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:14.512756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:14.513527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:14.513954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:14.620650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:14.629179 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:14.630691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:14.631967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2506b05d-72d6-4637-9344-64f2937f2c22 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.192657 Nov 11 01:05:14.632517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 221/441] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:14 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:14.678669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:14.688270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3c3c8cdb-5c6b-49e4-8335-49600a70db0e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.186971 Nov 11 01:05:14.688837 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 221/442] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:14 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:14.960001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:14.960937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:14.968898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:14.969346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:14.970137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:14.970566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.053854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:15.054476 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:15.060340 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:15.060791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.061567 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:15.062034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.198521 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:15.205904 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-43b7d61b-60e6-44a5-ba53-9192e60b7c25 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.155715 Nov 11 01:05:15.206470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 222/443] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:15 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:15.650270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:15.651022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:15.657151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:15.657598 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.658875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:15.659341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.794632 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:15.803394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:15.804907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:15.806078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2683ffb8-1c13-4fda-a919-d48e65234f8b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.159646 Nov 11 01:05:15.806641 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 223/444] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:15 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:15.810916 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:15.811547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:15.817361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:15.817808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.818586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:15.819050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:15.951328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:15.966037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dc1e75d4-5fd6-43da-a613-5208c35efd04 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.158160 Nov 11 01:05:15.966665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 224/445] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:15 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:16.223294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:16.223937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:16.230209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:16.230653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:16.231456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:16.231889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:16.364495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:16.371760 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c1996bfb-845f-42dc-8f50-5325814cb72e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.153260 Nov 11 01:05:16.372326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 225/446] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:16 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:16.824178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:16.824836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:16.831565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:16.832011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:16.832775 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:16.833202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:16.964577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:16.973488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:16.975017 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:16.976187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ad7f869b-1158-4395-a9fb-dfe1f4ced7e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.155748 Nov 11 01:05:16.976737 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 226/447] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:16 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:16.984233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:16.985616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:16.991970 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:16.992448 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:16.993191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:16.993616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:17.125945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:17.134250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c3fcdd28-43cc-4058-82b3-bc3be5003e09 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.153531 Nov 11 01:05:17.134848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 227/448] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:16 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:17.389249 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:17.389966 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:17.396516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:17.396979 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:17.398305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:17.398305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:17.543831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:17.552585 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f0b7b7b9-a972-4c63-9b1e-5992c7209fcd tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.167067 Nov 11 01:05:17.553201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 228/449] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:17 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:17.995261 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:17.995955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:18.002541 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:18.003009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:18.003794 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:18.004257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:18.136900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:18.144949 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:18.146456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:18.147694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3531a3bf-22d3-47f2-a886-4fdf80deb17f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.156500 Nov 11 01:05:18.148259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 229/450] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:17 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:18.152445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:18.153034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:18.159919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:18.160410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:18.161239 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:18.161708 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:18.295082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:18.302389 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-64835008-5e54-4345-bdaa-c32b00fa3368 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.153206 Nov 11 01:05:18.302969 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 230/451] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:18 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:18.569081 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:18.570049 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:18.577402 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:18.577402 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:18.577674 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:18.577924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:18.687430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6f7e22ed-d03c-483e-9312-fdaeb0f4afd1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 15064 microversion: 2.1 time: 3.731119 Nov 11 01:05:18.688877 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 222/452] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:14 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 15064 bytes in 3734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:18.722178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:18.729619 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-86264f81-a85c-43d7-b3dd-866817ede03c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.164426 Nov 11 01:05:18.730187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 231/453] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:18 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:19.166847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:19.167503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:19.174879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.175354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.176118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.176549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.306075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:19.314090 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:19.316173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:19.317334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8dfd6e75-ff8e-42fe-88da-979b1cb80278 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.154678 Nov 11 01:05:19.317875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 223/454] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:19 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:19.320701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:19.321314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:19.327616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.328064 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.328841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.329277 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.458087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:19.471687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-217bfaa5-c223-43e7-b283-bac1cdfe8de1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.154578 Nov 11 01:05:19.472274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 232/455] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:19 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:19.700415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:19.701366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:19.707991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.708434 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.709196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.709624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.748515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:19.749129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:19.754909 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.755390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.756169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:19.756605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:19.896325 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:19.904231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5eb8cc80-e739-43cf-908f-9a1c1693839d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.159565 Nov 11 01:05:19.904576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cb619a00-dfcd-4ff8-92c0-2301f8f2faf7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 16450 microversion: 2.1 time: 0.207603 Nov 11 01:05:19.904801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 233/456] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:19 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:19.905224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 224/457] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:19 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 16450 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:20.335465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:20.336058 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:20.342683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.343166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.343959 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.344387 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.472334 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:20.479979 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:20.481511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:20.482670 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8918c54a-2983-4873-ba61-1c5bb175e7ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.150879 Nov 11 01:05:20.485494 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 234/458] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:20 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:20.489337 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:20.490037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:20.497248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.497702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.498491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.498928 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.653030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:20.662982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cb034242-b6c1-4faa-b878-95d8896aac51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1509 microversion: 2.1 time: 0.178483 Nov 11 01:05:20.663562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 225/459] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:20 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:20.915179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:20.916170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:20.921117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:20.921720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:20.922545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.923066 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.924508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.924948 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.928535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.928979 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:20.929747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:20.930173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.068076 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:21.077288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e4da8f2f-8137-4935-a680-ff946ad39614 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.159505 Nov 11 01:05:21.078143 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 226/460] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:20 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:21.105746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7656a4d2-5467-43de-bae6-e5d8636a51ca tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 17602 microversion: 2.1 time: 0.194115 Nov 11 01:05:21.106484 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 235/461] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:20 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 17602 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:21.506893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:21.507526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:21.513886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.514326 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.515133 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.515564 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.657065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:21.667586 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:21.669141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:21.670432 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3f9c07b0-ca51-4ef8-a445-03ff79bac6ce tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.167218 Nov 11 01:05:21.671069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 227/462] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:21 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:21.681096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:21.681889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:21.690028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.690265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b3d434-62a2-4042-a7ae-4b41576871df"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:21.690527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.691416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:21.691539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.691891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.697298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.697750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.698531 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.698984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.778288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] HTTP exception thrown: Invalid volume: volume 43b3d434-62a2-4042-a7ae-4b41576871df is already attached to instances: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea Nov 11 01:05:21.779420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Returning 400 to user: Invalid volume: volume 43b3d434-62a2-4042-a7ae-4b41576871df is already attached to instances: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:05:21.780138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3220c199-3632-487c-8bfe-0e10c33d1e02 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094012 Nov 11 01:05:21.780644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 228/463] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:05:21 2021] POST /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 11 01:05:21.840153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:21.848302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:21.848825 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f04903ee-9422-4223-9e26-20392e4644db tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1515 microversion: 2.1 time: 0.172076 Nov 11 01:05:21.849065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:21.850990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 236/464] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:21 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:21.855648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.856239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.857027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:21.857655 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:21.994000 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'services' on Instance uuid 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:05:22.097689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:22.098308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:22.116514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.116929 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-46dd6c95-686f-4340-a9ec-5e42b283df58 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments/43b3d434-62a2-4042-a7ae-4b41576871df" status: 202 len: 0 microversion: 2.1 time: 0.272896 Nov 11 01:05:22.117417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.118012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 229/465] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:05:21 2021] DELETE /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments/43b3d434-62a2-4042-a7ae-4b41576871df => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:05:22.122241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.122733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.125240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:22.126550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:22.134102 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.134832 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.136231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.136880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.296163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:22.304445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cf9c10f8-b86f-4a9b-bd98-4d1ceba74dc7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.212918 Nov 11 01:05:22.305008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 237/466] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:22 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:22.309730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:22.310671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:22.316739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.317188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.318107 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.318545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.329676 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3b8f2631-a453-4a0a-8b40-d699beec17fd tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 17602 microversion: 2.1 time: 0.209826 Nov 11 01:05:22.331676 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 230/467] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:22 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 17602 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:22.350056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5a17e620-00d0-42ca-a8cd-c77e380f6c4c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Nov 11 01:05:22.350652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 238/468] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:05:22 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:22.690388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:22.691203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:22.698036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.698479 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.699285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.699779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.770315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-7755c0da-493d-4848-87bf-bc9a1eb5dbe6 req-8e8d0a60-8538-4ca3-bd65-2de07190f821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf1d23b-4934-4920-b304-0958f87dd3c5", "name": "network-vif-plugged", "status": "completed", "tag": "d6b56662-d64b-46ed-a321-18629bfb4927"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:22.772047 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:05:22.772047 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:05:22.780585 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-7755c0da-493d-4848-87bf-bc9a1eb5dbe6 req-8e8d0a60-8538-4ca3-bd65-2de07190f821 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:22.781376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-7755c0da-493d-4848-87bf-bc9a1eb5dbe6 req-8e8d0a60-8538-4ca3-bd65-2de07190f821 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:22.794021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-7755c0da-493d-4848-87bf-bc9a1eb5dbe6 req-8e8d0a60-8538-4ca3-bd65-2de07190f821 service nova] Creating event network-vif-plugged:d6b56662-d64b-46ed-a321-18629bfb4927 for instance 7cf1d23b-4934-4920-b304-0958f87dd3c5 on hv-cinder-81708 Nov 11 01:05:22.799382 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-7755c0da-493d-4848-87bf-bc9a1eb5dbe6 req-8e8d0a60-8538-4ca3-bd65-2de07190f821 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Nov 11 01:05:22.800036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 239/469] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:05:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:22.843306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:22.852673 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:22.854153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:22.855342 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-331d2323-37b8-410b-8963-bf4c19c3b766 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.169431 Nov 11 01:05:22.855898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 231/470] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:22 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:23.225276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:23.225981 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:23.231897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.232338 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.233103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.233527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.327527 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:23.328304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:23.335637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.336123 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.337108 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.337587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.372893 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:23.381213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3e128d32-16aa-4b5f-a277-1a6b191aa705 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1515 microversion: 2.1 time: 0.159941 Nov 11 01:05:23.381725 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 240/471] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:23 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:23.386161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:23.387096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:23.393815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.394258 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.395066 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.395501 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.476623 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:23.483911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1102310a-6f45-43a5-ba39-526cdaca1d9c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.165830 Nov 11 01:05:23.484674 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 232/472] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:23 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:23.490335 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:23.491281 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:23.497858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.498308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.499274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.499710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.530837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e9eb3e88-2ac5-46d9-a0ff-8dc9344b210c tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Nov 11 01:05:23.531458 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 233/473] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:05:23 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:23.536217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87572d7d-87f3-43e0-9265-62d4efcd907d"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:23.537374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:23.542876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.543357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:23.544123 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:23.544583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.003073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5ad3b362-f28d-4560-ac46-da8a15562695 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 19133 microversion: 2.1 time: 0.620058 Nov 11 01:05:24.003869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 241/474] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:23 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 19133 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:24.009932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:24.010629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:24.017210 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:24.017746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.018534 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:24.018988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.146806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1eefdf80-bf77-49d9-ba0f-f4e817d30911 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614033 Nov 11 01:05:24.148394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 234/475] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:05:23 2021] POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:24.186699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:24.197816 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:24.199823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:24.201373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7726cc07-df73-4691-a4ae-d5abfb0952e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.196418 Nov 11 01:05:24.202432 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 242/476] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:24 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:24.502578 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:24.503226 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:24.509357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:24.509803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.510727 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:24.511402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.541793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:24.542804 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:24.550461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:24.551042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.551751 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:24.552210 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:24.585501 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4f4ee526-7e34-48d7-b9a6-c82afad4f169 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047673 Nov 11 01:05:24.586075 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 243/477] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:05:24 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:05:24.643392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:24.650607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a180eec1-5b66-41e8-9d15-d919e1965597 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.152710 Nov 11 01:05:24.651199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 235/478] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:24 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:25.015829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:25.016747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:25.023513 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.024020 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.024849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.025282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.210612 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f43691c2-ae8d-4edf-9b40-5797849bdc6f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 19446 microversion: 2.1 time: 0.198700 Nov 11 01:05:25.211586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 244/479] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:25 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 19446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:25.222316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:25.222991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:25.229660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.230143 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.231057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.231662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.404310 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:25.412999 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:25.414629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:25.415998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3cc095d0-6378-45bc-84af-95c0c8d89b56 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.198311 Nov 11 01:05:25.416630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 236/480] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:25 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:25.597875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:25.598931 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:25.605617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.606060 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.606833 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.607291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.639626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-048582fb-1641-4f61-9216-0b8fc55bb907 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045777 Nov 11 01:05:25.640677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 245/481] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:05:25 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:05:25.670720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:25.670720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:25.675754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.676206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.677206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:25.677820 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:25.818043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-778985340", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "232e5fb8-96bd-4e33-ad1f-50b0e7e803d2"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:25.865309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:25.872498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3204fcd9-dba5-4245-9092-c4cfe591082c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.209284 Nov 11 01:05:25.878755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] validate_networks() for [('232e5fb8-96bd-4e33-ad1f-50b0e7e803d2', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:05:25.888633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 237/482] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:25 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:26.224108 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:26.225131 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:26.231686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.233903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.234888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.235557 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.365330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:05:26.366186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:05:26.366186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:05:26.366644 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:05:26.367166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:05:26.377137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.377827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.378663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.379102 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.395540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:05:26.399348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Getting quotas for user 325e6f2cc9e0420a8f09d879000375d3 and project 43ffc4ef7782463480e07227c26cfa47. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:05:26.410292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:05:26.412621 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:05:26.430359 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c2b0127e-bdf6-49b7-bc3f-bb8987e7381f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 21069 microversion: 2.1 time: 0.210681 Nov 11 01:05:26.431244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 238/483] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:26 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 21069 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:26.436736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:26.437551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:26.445578 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.446155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.446934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.447391 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.458447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-91c8b14a-14fd-411a-9634-842d1a59e0f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645696 Nov 11 01:05:26.459395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 246/484] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:05:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:05:26.469123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d9a534de-173e-46f9-a65f-68c0d8a94650 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:26.469751 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d9a534de-173e-46f9-a65f-68c0d8a94650 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:26.563142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d9a534de-173e-46f9-a65f-68c0d8a94650 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:26.570776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d9a534de-173e-46f9-a65f-68c0d8a94650 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1217 microversion: 2.1 time: 0.105205 Nov 11 01:05:26.571501 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 247/485] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:26 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:26.634600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:26.643286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:26.644791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:26.645955 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-881a7e0e-d9e2-4690-a753-aa63f6a92592 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.213679 Nov 11 01:05:26.646506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 239/486] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:26 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:26.889504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:26.890291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:26.898633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.899198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:26.900206 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:26.900707 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.056792 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:27.064765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2e68f83f-a36d-416a-a89b-7d03a827d98a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1509 microversion: 2.1 time: 0.178477 Nov 11 01:05:27.065846 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 248/487] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:26 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:27.442462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:27.443446 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:27.449795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:27.450232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.451200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:27.452075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.588589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:27.589478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:27.595261 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:27.595650 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.596419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:27.596847 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.646898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8cfe4238-d461-4068-b3e2-40d152268939 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 22057 microversion: 2.1 time: 0.208627 Nov 11 01:05:27.650812 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 240/488] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:27 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 22057 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:27.655394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:27.664082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-28080226-be88-43b5-802b-a06f0c1c2be0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1269 microversion: 2.1 time: 0.079224 Nov 11 01:05:27.664672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 249/489] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:27 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1269 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:27.666357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:27.667151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:27.676155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:27.676603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.677365 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:27.677801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:27.811205 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:27.819759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:27.821263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:27.822410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-75ada543-ab06-4f81-a775-2d39767d8674 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1745 microversion: 2.20 time: 0.161464 Nov 11 01:05:27.822986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 241/490] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:27 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:28.658630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:28.660344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:28.666730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:28.667201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:28.668009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:28.668442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:28.681291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:28.682720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:28.695751 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:28.696467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:28.697846 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:28.698502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:28.765958 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:28.773671 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0c1960b9-64d3-4469-86b2-348203d50f33 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1275 microversion: 2.1 time: 0.096318 Nov 11 01:05:28.779348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 242/491] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:28 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:28.840174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:28.841125 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:28.847414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:28.847881 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:28.848886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:28.849355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:28.865570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-270b475f-21a0-4512-adec-6cde4ea63c2e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 22965 microversion: 2.1 time: 0.211250 Nov 11 01:05:28.867288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 250/492] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:28 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 22965 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:29.009509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:29.017349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:29.019150 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:29.020321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4f194fa3-3b00-449a-af71-567f250854c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1745 microversion: 2.20 time: 0.184115 Nov 11 01:05:29.021240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 243/493] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:28 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:29.739257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-d83a7b29-f5f1-40d8-9594-07caecd3f85c req-88d4ec35-913a-4bd4-8d8f-771a3605f723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fe6d69-769b-4ce1-b14e-8edaba02d820", "tag": "f404b098-501c-4bdf-9b3e-0b0821536e87"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:29.740734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:05:29.740734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:05:29.748729 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-d83a7b29-f5f1-40d8-9594-07caecd3f85c req-88d4ec35-913a-4bd4-8d8f-771a3605f723 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:29.748944 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-d83a7b29-f5f1-40d8-9594-07caecd3f85c req-88d4ec35-913a-4bd4-8d8f-771a3605f723 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:29.762405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-d83a7b29-f5f1-40d8-9594-07caecd3f85c req-88d4ec35-913a-4bd4-8d8f-771a3605f723 service nova] Creating event network-changed:f404b098-501c-4bdf-9b3e-0b0821536e87 for instance a0fe6d69-769b-4ce1-b14e-8edaba02d820 on hv-cinder-81708 Nov 11 01:05:29.766848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-d83a7b29-f5f1-40d8-9594-07caecd3f85c req-88d4ec35-913a-4bd4-8d8f-771a3605f723 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032192 Nov 11 01:05:29.767992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 251/494] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:05:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:29.790491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:29.791118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:29.797397 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:29.797845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:29.799153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:29.799591 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:29.880053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:29.881027 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:29.889423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:29.889940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:29.890723 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:29.891211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:29.936553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:29.944087 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0a4339ed-8eee-4b9d-baf6-6eb198f8f3a5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.157238 Nov 11 01:05:29.944659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 244/495] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:29 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:30.038282 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:30.038894 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:30.044850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:30.045300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:30.046075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:30.046508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:30.183012 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-05ee4fd6-98ff-4e8d-8df0-29d7912cb5ad tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 23213 microversion: 2.1 time: 0.308631 Nov 11 01:05:30.183561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:30.183689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 252/496] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:29 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 23213 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:30.192022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:30.193509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:30.194661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cd14d4f1-9140-4c49-8fda-a5b46a538b93 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1745 microversion: 2.20 time: 0.160115 Nov 11 01:05:30.195238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 245/497] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:30 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:30.797698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-e7618059-9901-4d7c-b38c-c4c219e45473 req-6ddb65fc-3f89-4b4e-aa47-7c6a9de0bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "name": "network-vif-plugged", "status": "completed", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:30.799252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:05:30.799252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:05:30.807305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-e7618059-9901-4d7c-b38c-c4c219e45473 req-6ddb65fc-3f89-4b4e-aa47-7c6a9de0bfc0 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:30.807924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-e7618059-9901-4d7c-b38c-c4c219e45473 req-6ddb65fc-3f89-4b4e-aa47-7c6a9de0bfc0 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:30.819789 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-e7618059-9901-4d7c-b38c-c4c219e45473 req-6ddb65fc-3f89-4b4e-aa47-7c6a9de0bfc0 service nova] Creating event network-vif-plugged:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:05:30.824694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-e7618059-9901-4d7c-b38c-c4c219e45473 req-6ddb65fc-3f89-4b4e-aa47-7c6a9de0bfc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031041 Nov 11 01:05:30.825292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 253/498] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:05:30.961396 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:30.962062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:30.969367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:30.969765 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:30.970698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:30.971161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:31.104140 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:31.111897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c0c1d810-eca5-446b-a97d-25500dd12e3d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.154070 Nov 11 01:05:31.112456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 246/499] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:30 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:31.195063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:31.196509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:31.202907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:31.203470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:31.204327 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:31.205259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:31.212097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:31.212707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:31.219464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:31.219909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:31.221346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:31.221784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:31.355842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:31.363599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:31.365123 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:31.366270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1f1106af-7a5e-4d93-a1ff-ae093174ef05 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1745 microversion: 2.20 time: 0.157916 Nov 11 01:05:31.366820 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 247/500] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:31 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:31.463250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cab15b8f-b020-405e-a660-aac38f44e7e0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 23220 microversion: 2.1 time: 0.272520 Nov 11 01:05:31.463913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 254/501] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:31 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 23220 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:32.129520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:32.130038 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:32.136500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:32.136946 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:32.137725 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:32.138158 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:32.272401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:32.279829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4334499c-d55e-49bd-a12c-43f7d673a25a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.155020 Nov 11 01:05:32.280423 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 248/502] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:32 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:32.386325 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:32.386966 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:32.394499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:32.394965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:32.395745 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:32.396179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:32.475029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:32.476095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:32.481977 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:32.482428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:32.483236 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:32.483732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:32.528264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:32.535988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:32.537497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:32.538649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ab28f30b-2472-4162-9eb7-f3a9f25991e5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.156541 Nov 11 01:05:32.539239 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 255/503] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:32 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:32.653110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-60403e80-3924-47d7-82b7-7afa26a6375f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 23874 microversion: 2.1 time: 0.181473 Nov 11 01:05:32.656964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 249/504] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:32 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 23874 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:33.296325 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:33.296939 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:33.304929 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.305376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.306151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.306584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.450803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:33.458040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1c57f6bc-7623-48c6-adba-5aeaad53f6b6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.165373 Nov 11 01:05:33.458608 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 256/505] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:33 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:33.558030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:33.558628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:33.566507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.566977 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.567764 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.568204 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.664572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:33.665486 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:33.672319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.673018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.674859 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.675401 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.704723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:33.713389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:33.715237 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:33.716399 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f69959b1-5399-446a-b89e-e14685ea4d7d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.162509 Nov 11 01:05:33.719026 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 250/506] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:33 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:33.788926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:33.789868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:33.795768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.796222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.796994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.797432 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.819768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lazy-loading 'flavor' on Instance uuid 45620e84-de01-477d-a818-263dae68f119 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:05:33.855204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8a24c201-5005-4203-8e53-6fcf8bcb2362 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 24441 microversion: 2.1 time: 0.194097 Nov 11 01:05:33.859105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 257/507] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:33 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 24441 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:33.976089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9d10a189-3f8c-46ce-bb6f-31722ba12f29 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action" status: 200 len: 32 microversion: 2.1 time: 0.190856 Nov 11 01:05:33.976697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 251/508] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:33 2021] POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:05:33.986510 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:33.987234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:33.994150 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.994630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:33.995452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:33.995888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.131686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:34.139451 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-546ffaa5-654f-41e5-b280-72d651fc0627 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.157507 Nov 11 01:05:34.140016 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 258/509] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:33 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:34.476322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:34.477019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:34.483716 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:34.484269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.485081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:34.485510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.624222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:34.631976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ba4b9e0e-49c2-4ba5-9f84-5be222feb5ea tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.160150 Nov 11 01:05:34.632531 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 252/510] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:34 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:34.735054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:34.736193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:34.742700 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:34.743193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.743975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:34.744404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.867333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:34.868309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:34.874377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:34.874760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.875583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:34.876017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:34.879115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:34.886919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:34.888438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:34.889597 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ea85b45f-e24a-466b-8b0e-6cf8b731170d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.158290 Nov 11 01:05:34.890160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 259/511] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:34 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:35.036806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0c362ba6-9072-4a8a-b574-5885c703c897 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 25131 microversion: 2.1 time: 0.172851 Nov 11 01:05:35.037452 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 253/512] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:34 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 25131 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:35.157090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:35.158197 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:35.164415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:35.164861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:35.165633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:35.166063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:35.294835 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:35.303891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4fc0c459-4573-45fe-a420-f5a808993441 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.150520 Nov 11 01:05:35.304469 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 260/513] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:35 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:35.650106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:35.650885 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:35.659538 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:35.659992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:35.660907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:35.661415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:35.792784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:35.800752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-646eb8cc-5473-4808-bee4-a5b7d3d8b2ab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.154942 Nov 11 01:05:35.801338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 254/514] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:35 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:35.908710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:35.909310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:35.915476 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:35.915924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:35.916684 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:35.917109 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.048561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:36.049537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:36.051638 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:36.055761 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:36.056207 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.056984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:36.057407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.059351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:36.060901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:36.062082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dea7465a-20d1-41a5-aa30-f84e0845a9ba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.157794 Nov 11 01:05:36.062641 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 261/515] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:35 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:36.229018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a8a5ed68-1f1c-4545-8595-c42950ef0992 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 25720 microversion: 2.1 time: 0.183965 Nov 11 01:05:36.229562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 255/516] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:36 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 25720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:36.321714 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:36.322331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:36.328333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:36.328781 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.329756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:36.330207 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.458725 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:36.466652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-84971c4d-7d30-4db3-92af-1583e4746f1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.148583 Nov 11 01:05:36.467251 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 262/517] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:36 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:36.818030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:36.818779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:36.825651 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:36.826096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.826864 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:36.827323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:36.958804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:36.968008 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8cf4fc1b-ed31-4213-98f0-bd83b3932856 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.153904 Nov 11 01:05:36.968605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 256/518] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:36 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:37.081463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:37.082026 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:37.088408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.088857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.089894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.090330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.219773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:37.228030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:37.229512 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:37.230662 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-86fba1aa-6acb-4bda-815a-8a774b3797b7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.153574 Nov 11 01:05:37.231238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 263/519] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:37 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:37.240061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:37.241094 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:37.247355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.247802 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.248574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.249006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.402608 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-70f1d2ae-5cea-49a5-871d-b6875c8084d6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 26347 microversion: 2.1 time: 0.165907 Nov 11 01:05:37.403481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 257/520] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:37 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 26347 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:37.483110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:37.483752 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:37.489843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.490292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.491089 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.491526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.620614 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:37.630412 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0191a66b-face-4cdb-99db-5b112945b1ab tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.150577 Nov 11 01:05:37.631029 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 264/521] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:37 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:37.986312 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:37.987040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:37.993854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.994303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:37.995106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:37.995539 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.126403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:38.134050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9fed913f-526d-4a5e-992c-23195b6e68f2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.152232 Nov 11 01:05:38.134611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 258/522] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:37 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:38.249190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:38.249725 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:38.256225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:38.256662 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.257439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:38.257864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.390173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:38.398461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:38.400016 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:38.401221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b2f52520-5b66-4938-8cb0-58a9729f1231 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.155844 Nov 11 01:05:38.401823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 265/523] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:38 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:38.413981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:38.415016 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:38.421252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:38.421704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.422481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:38.422913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.618032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c4ab6e0d-b51e-4658-8501-cf766aa2157a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 26865 microversion: 2.1 time: 0.207494 Nov 11 01:05:38.621899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 259/524] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:38 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 26865 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:38.647437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:38.648035 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:38.653730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:38.654199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.654985 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:38.655416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:38.793824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:38.802815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3f13f53b-3912-417b-a82f-7f140cfe7ce7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.158944 Nov 11 01:05:38.803427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 266/525] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:38 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:39.151347 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:39.151945 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:39.159308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.159750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.160511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.160937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.299972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:39.307143 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e84394ff-b5e8-4531-a8aa-0860e5669a44 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.159891 Nov 11 01:05:39.307707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 260/526] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:39 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:39.420734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:39.421299 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:39.428449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.428894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.429669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.430100 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.557542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:39.566006 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:39.567849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:39.569278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0def84b0-6395-4e8e-b21a-f2b9536a5efc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.152755 Nov 11 01:05:39.569911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 267/527] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:39 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:39.632054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:39.633256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:39.640817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.641351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.642607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.642732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.819643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:39.820246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:39.826137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.826578 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.827381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:39.827814 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:39.842857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-90f20ccb-66c6-40e9-a643-3e03984f933c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 27262 microversion: 2.1 time: 0.215202 Nov 11 01:05:39.843555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 261/528] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:39 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 27262 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:39.964751 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:39.973553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dcbc3cb1-3390-48e4-8349-082b22b37037 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.157583 Nov 11 01:05:39.974111 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 268/529] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:39 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:40.324886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:40.325582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:40.333054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.333497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.334345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.334802 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.470379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:40.478435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c9e1a7f3-5c0e-4e1a-bc25-8f07db610a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.157517 Nov 11 01:05:40.479023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 262/530] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:40 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:40.587770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:40.588370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:40.595116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.595669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.596446 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.596877 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.729544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:40.739199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:40.740707 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:40.741912 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f75f510d-008b-4e76-8803-4a0a285efe9b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.157780 Nov 11 01:05:40.742476 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 269/531] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:40 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:40.855541 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:40.856417 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:40.862562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.863049 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.863817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.864249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.989440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:40.990169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:40.996033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.996479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:40.997250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:40.997685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:41.014299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-af3bfa86-33cc-4633-a284-01ffc8914831 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 27664 microversion: 2.1 time: 0.162291 Nov 11 01:05:41.018615 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 263/532] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:40 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 27664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:41.361185 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:41.369280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7f4175be-3453-42fc-9fa1-d3405535cdf1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.383560 Nov 11 01:05:41.369853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 270/533] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:40 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:41.495686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:41.496633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:41.505921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:41.506369 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:41.507192 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:41.507630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:41.635997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:41.644719 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a7f61e6e-6e3d-4c2e-bc34-3fa0e799721d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.153680 Nov 11 01:05:41.645279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 264/534] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:41 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:41.759367 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:41.759968 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:41.766211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:41.766692 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:41.768008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:41.768439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:41.897379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:41.904853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:41.906372 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:41.908560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3f86d7c5-a338-4052-b062-b6f81a32ae3f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.151903 Nov 11 01:05:41.909159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 271/535] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:41 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:42.026785 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:42.027755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:42.034697 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.035233 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.036024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.036471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.300729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a30affdf-4823-425b-b96b-5d2bba1cf18a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 27845 microversion: 2.1 time: 0.277674 Nov 11 01:05:42.301370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 265/536] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:42 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 27845 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:42.388572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:42.389172 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:42.395862 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.396305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.397158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.397540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.526551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:42.536210 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8e1dacb3-83a9-4384-8292-ae0a141dd337 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.151216 Nov 11 01:05:42.536824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 272/537] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:42 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:42.661901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:42.662526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:42.669332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.669780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.670555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.671024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.812009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:42.820128 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-56a3beb8-99d3-4a18-89da-e5adad8b0ed5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.162313 Nov 11 01:05:42.820762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 266/538] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:42 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:42.925927 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:42.926601 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:42.932980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.933430 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:42.934228 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:42.934666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:43.078491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:43.087233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:43.088925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:43.090552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0b1a45f5-aa02-41be-b2e2-4c01252a1de4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.168689 Nov 11 01:05:43.091542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 273/539] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:42 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:43.312648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:43.313698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:43.320353 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:43.321054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:43.322002 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:43.322686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:43.553488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:43.554062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8eb8106a-9b46-41dd-af15-146e70663372 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28011 microversion: 2.1 time: 0.244376 Nov 11 01:05:43.554710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 267/540] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:43 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28011 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:43.554996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:43.562179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:43.562847 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:43.564803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:43.565451 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:43.722040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:43.730382 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-21514905-f09f-4df0-b38e-963be6c9b936 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.180496 Nov 11 01:05:43.731164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 274/541] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:43 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:43.837940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:43.838859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:43.846993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:43.847598 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:43.848404 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:43.848831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.007980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:44.016012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9cc3938d-b6e6-4aeb-a090-26a5a2aa4b6f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.182128 Nov 11 01:05:44.018815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 268/542] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:43 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:44.109262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:44.109777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:44.116986 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:44.117440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.118262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:44.118699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.354705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:44.366731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:44.369266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:44.370866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a9084e3e-bb20-47da-9092-d2ada52949b2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.265404 Nov 11 01:05:44.371697 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 275/543] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:44 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:44.566987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:44.568594 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:44.575927 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:44.576590 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.577533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:44.577963 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.751784 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:44.759722 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:44.772114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:44.772917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.773984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:44.775212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:44.823609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-db3a2e96-055b-4bae-9609-e78cb7c20209 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28086 microversion: 2.1 time: 0.261582 Nov 11 01:05:44.828238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 269/544] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:44 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28086 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:44.973877 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:44.982243 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-59f1f908-efd6-4cf8-a0e6-b0dcfe839a0f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.236963 Nov 11 01:05:44.989330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 276/545] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:44 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:45.038665 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:45.039781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:45.055846 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:45.056301 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:45.057108 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:45.057817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:45.209071 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:45.217039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cf75a50e-db61-4e43-a3df-4f51fdb7b570 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.186344 Nov 11 01:05:45.226715 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 270/546] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:45 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:45.397323 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:45.398491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:45.406151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:45.406875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:45.408289 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:45.409036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:45.579154 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:45.587529 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:45.591360 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:45.593617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0d864561-1887-40e4-a888-ce5afdffa108 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.200522 Nov 11 01:05:45.605187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 277/547] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:45 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:45.842210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:45.843640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:45.852647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:45.853804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:45.854609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:45.857496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.000012 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:46.000757 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:46.007490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:46.007938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.008727 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:46.009170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.038206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d4a894e4-bd2d-4758-b5d0-b70b6f73e1f4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.205084 Nov 11 01:05:46.043084 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 271/548] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:45 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:46.154013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:46.165333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-67cc8f86-90d2-4324-9754-450829a340a1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.169754 Nov 11 01:05:46.165911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 278/549] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:45 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:46.233783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:46.234834 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:46.241896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:46.242350 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.243163 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:46.243605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.402544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:46.410610 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fb3b537e-a667-43ff-bf74-7c691a2ed1c5 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.180696 Nov 11 01:05:46.420413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 272/550] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:46 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:46.613353 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:46.614696 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:46.621152 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:46.622008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.623146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:46.623792 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:46.769834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:46.778531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:46.780172 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:46.781416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-84f128de-a5d6-43bd-88e4-eba4b3edf20a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.172780 Nov 11 01:05:46.792314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 279/551] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:46 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:47.050488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:47.051459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:47.058629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.059120 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.059897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.060512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.183508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:47.184925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:47.191230 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.191730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.192583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.193022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.202051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7886336d-d5c9-4754-9bb5-214da0eb8ce7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.155564 Nov 11 01:05:47.203513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 273/552] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:47 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:47.343497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:47.352169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d9906931-eebd-4bd2-a4fa-c668cf011f4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.172454 Nov 11 01:05:47.353106 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 280/553] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:47 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:47.429897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:47.430627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:47.437992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.438505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.439377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.439808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.598744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:47.606264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d4908651-953c-436f-9d9d-8682c1cd701f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.181955 Nov 11 01:05:47.606835 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 274/554] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:47 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:47.801947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:47.802927 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:47.809785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.810633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.811535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:47.812199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:47.987237 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:47.997309 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:47.998810 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:48.000390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b0897361-8174-47a5-a315-076b77c25d3d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.203784 Nov 11 01:05:48.001481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 281/555] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:47 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:48.213889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:48.215791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:48.222976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:48.223499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:48.224253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:48.224686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:48.370009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:48.370616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:48.376932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:48.377385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:48.378164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:48.378596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:48.414806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fbb99c1c-c823-47ff-b3b1-f5bd52094439 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.204557 Nov 11 01:05:48.416344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 275/556] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:48 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:48.529818 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:48.538561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8e026418-1ed8-4399-8ef8-4a8ed047a24d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.172742 Nov 11 01:05:48.548491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 282/557] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:48 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:48.623872 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:48.624645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:48.633202 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:48.633646 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:48.634435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:48.634865 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:48.816559 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:48.824156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d6d274b7-8fbf-4ab8-b3fb-6fb841d130d3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.204863 Nov 11 01:05:48.824746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 276/558] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:48 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:49.020050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:49.024609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:49.034148 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.034960 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.035884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.036404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.186342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:49.196395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:49.197877 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:49.199077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-74ce327b-859c-4a71-80d7-72cba3d3824e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.183150 Nov 11 01:05:49.210972 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 283/559] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:49 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:49.427607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:49.429694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:49.445394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.445938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.446808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.447339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.555999 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:49.556609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:49.562642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.563126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.564980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.565427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.631917 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4aeae485-c385-4c73-b098-2cca49e50497 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.208676 Nov 11 01:05:49.635117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 277/560] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:49 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:49.752386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:49.760216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fcb26bfd-ef2c-4e71-91fe-9caefc4747ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.207834 Nov 11 01:05:49.760966 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 284/561] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:49 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:49.842793 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:49.843355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:49.851110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.851702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:49.852683 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:49.853119 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.020629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:50.028703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-818a89aa-a33b-4181-9c70-33e430378430 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.190564 Nov 11 01:05:50.029278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 278/562] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:49 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:50.260664 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:50.261943 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:50.271542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.272285 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.273123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.273623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.430018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:50.445193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:50.447178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:50.448541 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-178caae0-88a8-4c94-b254-18cb59f34fae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.192177 Nov 11 01:05:50.449631 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 285/563] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:50 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:50.644292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:50.645859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:50.653024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.653613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.665354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.665807 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.777320 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:50.777934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:50.785746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.787157 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.788397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.789325 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.855941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bb65e771-af32-4b83-9d43-3e0228868486 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.215487 Nov 11 01:05:50.856639 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 279/564] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:50 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:50.948815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-608a28e0-4cd9-4f2d-ba82-850db62caa60 req-9fc1fd69-a9d3-437d-8c8c-0a8b253d244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe6d69-769b-4ce1-b14e-8edaba02d820", "name": "network-vif-plugged", "status": "completed", "tag": "f404b098-501c-4bdf-9b3e-0b0821536e87"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:50.950321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:05:50.950321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:05:50.969173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-608a28e0-4cd9-4f2d-ba82-850db62caa60 req-9fc1fd69-a9d3-437d-8c8c-0a8b253d244d service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:50.970486 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-608a28e0-4cd9-4f2d-ba82-850db62caa60 req-9fc1fd69-a9d3-437d-8c8c-0a8b253d244d service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:50.980989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:50.989793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-45691919-049b-45d4-ad31-7a6e393322c1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.216119 Nov 11 01:05:50.990547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 286/565] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:50 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:50.999717 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-608a28e0-4cd9-4f2d-ba82-850db62caa60 req-9fc1fd69-a9d3-437d-8c8c-0a8b253d244d service nova] Creating event network-vif-plugged:f404b098-501c-4bdf-9b3e-0b0821536e87 for instance a0fe6d69-769b-4ce1-b14e-8edaba02d820 on hv-cinder-81708 Nov 11 01:05:51.009421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-608a28e0-4cd9-4f2d-ba82-850db62caa60 req-9fc1fd69-a9d3-437d-8c8c-0a8b253d244d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064159 Nov 11 01:05:51.012063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 280/566] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:05:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:05:51.046242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:51.046843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:51.054134 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:51.054576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:51.055378 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:51.055805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:51.240681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:51.250757 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7fb37055-1648-4173-ad77-df7bb9bedad1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.208153 Nov 11 01:05:51.255048 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 287/567] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:51 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:51.472455 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:51.473452 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:51.483308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:51.484110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:51.485421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:51.486034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:51.640755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:51.649122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:51.650634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:51.651857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9da93f25-ac89-4ac1-bd03-41a157cb3c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.187217 Nov 11 01:05:51.652419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 281/568] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:51 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:51.867638 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:51.868675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:51.875277 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:51.876284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:51.877382 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:51.877819 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.007306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:52.007924 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:52.017138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:52.017522 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.018309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:52.018743 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.148334 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-160cf59e-f2bb-4702-acec-e91ea5df71c8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.284303 Nov 11 01:05:52.149336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 288/569] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:51 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:52.171004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:52.180535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e75880e4-16df-42d1-9abd-dc6c76dcc7c3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.176912 Nov 11 01:05:52.190562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 282/570] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:52 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:52.278509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:52.279119 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:52.286978 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:52.287327 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.288114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:52.288539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.436206 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:52.444603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c1790ba4-99a7-4b9a-8767-32f76605e7de tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.180240 Nov 11 01:05:52.445195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 289/571] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:52 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:52.669629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:52.670227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:52.677638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:52.678080 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.678842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:52.679366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:52.806032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:52.813956 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:52.815474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:52.816621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-766bf50a-be03-432e-8749-e0ad91ac923b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1740 microversion: 2.20 time: 0.150590 Nov 11 01:05:52.817173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 283/572] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:52 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:53.159977 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:53.160870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:53.167816 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.168254 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.169034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.169471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.197471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:53.198070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:53.205472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.205912 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.206684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.207149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.334519 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:53.342414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-37850448-e2b0-43f2-a7b7-8191df089e03 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.148628 Nov 11 01:05:53.342996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 284/573] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:53 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:53.460901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:53.461419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:53.467317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.467761 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.468516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.468941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.473739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4289cc44-6eda-4b77-9b4b-87dbf25cbaed tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28319 microversion: 2.1 time: 0.317471 Nov 11 01:05:53.474413 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 290/574] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:53 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:53.604642 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:53.612360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8b534c77-4036-4c78-b90b-7492ccab96bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1317 microversion: 2.1 time: 0.155168 Nov 11 01:05:53.612942 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 285/575] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:53 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:53.835546 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:53.836294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:53.843362 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.843802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.845126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:53.845569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:53.982039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:53.990743 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:53.992269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:53.993404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6edd0b78-4ffb-465c-b339-4549f566cb0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1722 microversion: 2.20 time: 0.162188 Nov 11 01:05:53.993953 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 291/576] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:53 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:54.359638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:54.360793 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:54.366518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:54.366989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:54.367771 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:54.368208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:54.485610 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:54.486541 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:54.495503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:54.496267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:54.497162 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:54.497587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:54.518514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:54.527238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3bd7b38f-ab24-4b62-a190-397a3d0b7a4e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.171140 Nov 11 01:05:54.527942 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 286/577] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:54 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:54.629910 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:54.630520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:54.636284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:54.636735 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:54.637513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:54.637947 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:54.677891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-33011bc1-91a4-4396-a2e9-37bbfcec7573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28608 microversion: 2.1 time: 0.196029 Nov 11 01:05:54.681700 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 292/578] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:54 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28608 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:54.771070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:54.778351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ff2b550d-9240-4d5a-a3ee-c07a40a335bb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1507 microversion: 2.1 time: 0.153173 Nov 11 01:05:54.778913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 287/579] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:54 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:05:55.012041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:55.012823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:55.021518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:55.022041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:55.023089 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:55.023369 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:55.180455 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:55.188796 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:55.190313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:55.191509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2f944447-f1c9-4592-91cd-efc201f66df9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1722 microversion: 2.20 time: 0.183763 Nov 11 01:05:55.192100 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 293/580] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:55 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:55.545055 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:55.545666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:55.552796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:55.553245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:55.554059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:55.554497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:55.690034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:55.691097 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:55.697424 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:55.697865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:55.698650 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:55.699110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:55.706625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:55.715838 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9e13ceaa-1dbe-4b9b-8add-fdeff9471902 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.174380 Nov 11 01:05:55.716858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 288/581] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:55 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:55.895526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6b6b4ebb-f4f3-4364-8d96-23b32a46ecb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28608 microversion: 2.1 time: 0.209561 Nov 11 01:05:55.896183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 294/582] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:55 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28608 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:05:56.101343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3138c9a-eb08-483a-9be3-990e0ee8e6cc"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:56.102397 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:56.109089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.109530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.110889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.111390 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.210586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:56.211328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:56.218356 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.218802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.220000 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.220438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.360057 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:56.367858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:56.369440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:56.370756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8bae2083-6340-4904-818a-5b18bcea76e4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1722 microversion: 2.20 time: 0.164169 Nov 11 01:05:56.371408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 295/583] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:56 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:56.419374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f25e5543-2709-452f-b655-28570ba50170 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "POST /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321724 Nov 11 01:05:56.419972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 289/584] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:05:56 2021] POST /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:05:56.733854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:56.734465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:56.740934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.741384 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.742163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.742592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.887946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:56.896211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-041b229e-3535-4668-8965-2e8eb87005a3 req-a7ab922a-14ba-4388-b363-56dcd3517ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "name": "network-vif-unplugged", "status": "completed", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:56.897727 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:05:56.897727 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:05:56.912723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-041b229e-3535-4668-8965-2e8eb87005a3 req-a7ab922a-14ba-4388-b363-56dcd3517ed2 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.912723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-041b229e-3535-4668-8965-2e8eb87005a3 req-a7ab922a-14ba-4388-b363-56dcd3517ed2 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.912946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-658dad27-3162-431c-87f1-f16f75209f6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.181721 Nov 11 01:05:56.920849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 296/585] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:56 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:56.920849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:56.921663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:56.924064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-041b229e-3535-4668-8965-2e8eb87005a3 req-a7ab922a-14ba-4388-b363-56dcd3517ed2 service nova] Creating event network-vif-unplugged:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:05:56.928097 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.928553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.929340 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:56.929453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-041b229e-3535-4668-8965-2e8eb87005a3 req-a7ab922a-14ba-4388-b363-56dcd3517ed2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038327 Nov 11 01:05:56.929770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:56.930214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 290/586] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:05:57.200460 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e99bcb46-c086-45f2-8e3e-6526138a3295 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28608 microversion: 2.1 time: 0.283198 Nov 11 01:05:57.201105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 297/587] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:56 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28608 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:57.390587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:57.391516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:57.397877 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:57.398321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:57.399131 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:57.399901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:57.545416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:57.553570 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:57.555060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:57.556221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9293f4c0-30cc-4a9c-85df-23279b416cb0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1722 microversion: 2.20 time: 0.170236 Nov 11 01:05:57.556779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 291/588] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:57 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:57.931653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:57.932352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:57.941795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:57.942241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:57.943067 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:57.943496 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:58.089796 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:58.098467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-39bc23ce-cf7f-4f28-902a-e0c1d9ca7663 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.170854 Nov 11 01:05:58.099077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 298/589] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:57 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:58.212392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:58.213244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:58.220557 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:58.221001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:58.221769 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:58.222200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:58.403675 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8030191f-f4fe-4c17-a83c-89c4c38891e1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28772 microversion: 2.1 time: 0.194824 Nov 11 01:05:58.404452 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 292/590] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:58 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28772 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:58.575069 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:58.575679 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:58.582654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:58.583134 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:58.583910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:58.584374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:58.718514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:58.726710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:58.728305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:58.729442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5e17e853-985f-4876-b9cf-69c1d5c953a1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1722 microversion: 2.20 time: 0.158220 Nov 11 01:05:58.729989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 299/591] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:58 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:05:59.116530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:59.117232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:59.129269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.129721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.130508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.130983 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.280945 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:59.289341 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1e6b0ac4-a395-4433-ad1d-3418694bce97 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.176876 Nov 11 01:05:59.289926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 293/592] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:05:59 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:05:59.415753 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:59.416699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:59.423629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.424083 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.424865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.425304 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.651055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fb5d2c4c-5b36-41d7-b320-a4bcf27158a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.238886 Nov 11 01:05:59.651731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 300/593] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:05:59 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:05:59.748389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:05:59.749076 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:59.756026 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.756468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.757249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.757678 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.901682 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:59.910372 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:59.911905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:05:59.913093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-afe0c11f-c492-4bd2-852e-460468e3f117 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1725 microversion: 2.20 time: 0.168731 Nov 11 01:05:59.913684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 294/594] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:05:59 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:05:59.931540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39ed9f62-2194-41b3-a92a-ecc1de3a5bb5"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:05:59.932691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:05:59.940038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.940507 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:05:59.941270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:05:59.941711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.233578 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-07e01c09-3a7f-43f6-8266-5ed6980263c9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306165 Nov 11 01:06:00.234296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 301/595] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Nov 11 01:05:59 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:06:00.305995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:00.306591 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:00.313278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.313648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.314445 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.314973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.346445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:00.347038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:00.353288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.353733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.354506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.354936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.450856 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c6bebaec-fd48-4a7d-812f-10012c15de55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action" status: 202 len: 0 microversion: 2.20 time: 0.108754 Nov 11 01:06:00.451801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 302/596] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:06:00 2021] POST /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:06:00.461313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:00.462113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:00.463589 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:00.469381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.470702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.472458 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.472854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.473875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8dabebfd-a5bf-493f-8198-b2e60dd1e5f8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.171480 Nov 11 01:06:00.474540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 295/597] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:00 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:00.626642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:00.635997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:00.637509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:00.638637 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-715c3300-a6bb-45ff-8bcc-288bdb5a2c90 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1811 microversion: 2.20 time: 0.181891 Nov 11 01:06:00.639320 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 303/598] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:00 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:00.663078 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:00.664044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:00.670041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.670494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.671300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:00.671739 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:00.856899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b506ca26-f213-4fa6-82a2-34477539ffb8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.197342 Nov 11 01:06:00.861030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 296/599] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:00 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:06:01.495611 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:01.496375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:01.502934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:01.503421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:01.504268 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:01.504706 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:01.640634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:01.650192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-74aa7f9a-e015-4301-82b8-06416e05f66d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.158378 Nov 11 01:06:01.650782 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 304/600] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:01 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:01.658448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:01.659169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:01.665878 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:01.666326 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:01.667132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:01.667563 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:01.807494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:01.817244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:01.818754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:01.819954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-833b574b-20ee-42e0-9ed0-251e670b4b65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1753 microversion: 2.20 time: 0.166070 Nov 11 01:06:01.820506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 297/601] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:01 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:01.868879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:01.869895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:01.876204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:01.876652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:01.877424 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:01.877851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.037074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-07dd5fa4-ef1c-41f8-b987-bd9defaf95af tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.171913 Nov 11 01:06:02.037820 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 305/602] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:01 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:06:02.299788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-811192971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1852709330", "security_groups": [{"name": "tempest-secgroup-smoke-1841354698"}], "networks": [{"uuid": "281e6ff6-072e-460f-a0b4-bef0b3054b31"}], "block_device_mapping_v2": [{"uuid": "0cf50c67-1689-46a1-9e56-9c9b495fd688", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:02.415375 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] validate_networks() for [('281e6ff6-072e-460f-a0b4-bef0b3054b31', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:06:02.668474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:02.669166 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:02.676672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:02.677127 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.677902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:02.678335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.822334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:06:02.822828 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:06:02.823262 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:06:02.823676 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:06:02.824122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:06:02.834769 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:02.835730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.836795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:02.837227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.856137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Getting quotas for project 5dff1f2fb612458e95b9346b3d29040d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:06:02.864560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Getting quotas for user 92d2b8de9b734a48957f0aed750617f2 and project 5dff1f2fb612458e95b9346b3d29040d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:06:02.880133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:02.888841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1937aa1d-45c1-4a36-a677-78e54e90d9cd tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.224093 Nov 11 01:06:02.889434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 306/603] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:02 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:02.894686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:02.895376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:02.901205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:02.901902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.902870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:02.903691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:02.924458 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:06:02.926570 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cf50c67-1689-46a1-9e56-9c9b495fd688',volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:06:03.041093 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:03.051711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:03.053222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:03.054390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0c69edab-be23-440d-8098-a5e72168699d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1753 microversion: 2.20 time: 0.163816 Nov 11 01:06:03.055145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 307/604] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:02 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:03.060210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-51c99b96-4282-4f0c-b3d8-bb2379bc1a16 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764325 Nov 11 01:06:03.061041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 298/605] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:06:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 01:06:03.068807 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:03.069731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:03.071049 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-70352277-137e-4936-9600-46d41eeb5d10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:03.071855 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-70352277-137e-4936-9600-46d41eeb5d10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:03.078635 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:03.079235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:03.080040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:03.080479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:03.134413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-70352277-137e-4936-9600-46d41eeb5d10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:03.140734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-70352277-137e-4936-9600-46d41eeb5d10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1088 microversion: 2.1 time: 0.073134 Nov 11 01:06:03.141526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 299/606] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:03 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:03.224039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bc076434-91be-439f-aaa5-170a41a10381 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.167764 Nov 11 01:06:03.224677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 308/607] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:03 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:06:03.906964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:03.907574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:03.913613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:03.914088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:03.914853 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:03.915310 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.043839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:04.052020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c9e62074-a28f-4ddf-8b8d-7e8b7d779226 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.148818 Nov 11 01:06:04.052597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 300/608] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:03 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:04.073312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:04.074004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:04.080935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:04.081375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.082142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:04.082602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.157826 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:04.158434 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:04.165136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:04.165585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.166369 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:04.166869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.240194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:04.247496 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:04.247661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-da5a8436-0e62-4ebb-8e31-aa891697e00f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1186 microversion: 2.1 time: 0.093552 Nov 11 01:06:04.248188 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 301/609] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:04 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:04.254905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:04.255809 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:04.259108 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:04.260593 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:04.261751 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:04.261867 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-120ddee7-2f1a-4459-a151-2df3b8a870fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1753 microversion: 2.20 time: 0.192483 Nov 11 01:06:04.262198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.262301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 309/610] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:04 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:04.263208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:04.263650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:04.492844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-15e61a16-48f9-4c8b-be55-615cce56c22c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.243289 Nov 11 01:06:04.493516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 302/611] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:04 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:06:05.072416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:05.074115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:05.087347 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.088131 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.090196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.090932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.266935 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:05.267703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:05.280721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.281176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.283015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.283877 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.297595 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:05.309115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1a5f2e7c-ecca-4dd7-b542-acbc8bf14814 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.243065 Nov 11 01:06:05.320200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 310/612] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:05 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:05.325605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:05.326400 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:05.333882 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.334544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.335460 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.336070 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.365451 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:05.373942 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5977913b-2953-4e34-bf56-0d88b9598064 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1204 microversion: 2.1 time: 0.112471 Nov 11 01:06:05.374848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 303/613] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:05 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1204 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:05.502883 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:05.505659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:05.506685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:05.511452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:05.513036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.513169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:05.513582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.514341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cdcb9b94-6643-44f3-ae23-a0e3b1d065e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1753 microversion: 2.20 time: 0.192564 Nov 11 01:06:05.514441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:05.514898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 311/614] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:05 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:05.515041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:05.677681 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-53845fe2-2ccc-4e49-883a-a9357d7a2c84 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.175339 Nov 11 01:06:05.678344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 304/615] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:05 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:06:06.128317 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:06.131875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:06.138984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.139437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.140415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.140918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.233132 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'services' on Instance uuid a0fe6d69-769b-4ce1-b14e-8edaba02d820 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:06:06.327829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-102b7904-c53c-4a89-863e-5882a07c7aab tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments/d3138c9a-eb08-483a-9be3-990e0ee8e6cc" status: 202 len: 0 microversion: 2.1 time: 0.207040 Nov 11 01:06:06.328061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:06.328994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:06.332886 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 312/616] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:06:06 2021] DELETE /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments/d3138c9a-eb08-483a-9be3-990e0ee8e6cc => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:06:06.337320 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.337785 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.338994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.339153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:06.340603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:06.348123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.348786 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.349587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.350310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.351173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.393504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-340e4bd4-5911-47e0-9f71-af4aa2fca3cb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059048 Nov 11 01:06:06.394733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 313/617] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:06:06 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:06.399395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-3a959473-d6e4-4f55-b323-9f2c7646b62c req-dda76cf3-517b-44c3-853b-6f25167ddac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:06.401314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:06:06.401314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:06:06.410750 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-3a959473-d6e4-4f55-b323-9f2c7646b62c req-dda76cf3-517b-44c3-853b-6f25167ddac0 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.411528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-3a959473-d6e4-4f55-b323-9f2c7646b62c req-dda76cf3-517b-44c3-853b-6f25167ddac0 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.424210 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-3a959473-d6e4-4f55-b323-9f2c7646b62c req-dda76cf3-517b-44c3-853b-6f25167ddac0 service nova] Creating event network-changed:e56a395c-77ef-4622-a62e-fedb27621bdb for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 on hv-cinder-81708 Nov 11 01:06:06.429219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-3a959473-d6e4-4f55-b323-9f2c7646b62c req-dda76cf3-517b-44c3-853b-6f25167ddac0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033393 Nov 11 01:06:06.430293 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 314/618] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:06:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:06.435503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:06.436220 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:06.442872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.443443 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.444249 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.444720 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.585232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:06.596002 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-550c2c16-bcc2-4ab1-8eb9-fa6a97b184b0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.272126 Nov 11 01:06:06.604112 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 305/619] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:06 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:06.613833 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:06.614459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:06.621899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.622356 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.623213 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.623652 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.658749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:06.666322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6cc86353-e40d-4892-b169-60937b73661c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1272 microversion: 2.1 time: 0.234790 Nov 11 01:06:06.667077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 315/620] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:06 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:06.690785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:06.691746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:06.697438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.697891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.698684 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:06.699153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:06.771586 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:06.779870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:06.781391 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:06.782811 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ace00c3c-9ecc-4b79-ac82-6bc56c843215 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1753 microversion: 2.20 time: 0.177620 Nov 11 01:06:06.783435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 306/621] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:06 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:06.903551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fb5df0c7-e16c-43ac-8bf0-5ddb2684e016 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.216965 Nov 11 01:06:06.904214 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 316/622] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:06 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:06:07.404936 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:07.405846 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:07.412252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.412702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.413476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.413909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.451035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-71918554-8048-44bb-92eb-c1e95ca086f7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049730 Nov 11 01:06:07.451503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 307/623] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:06:07 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:07.613890 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:07.614717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:07.621590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.622041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.622821 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.623390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.682766 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:07.683663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:07.691609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.692366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.693392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.694023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.792298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:07.802888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-be340930-797e-4266-8b81-e61f9be73644 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.193203 Nov 11 01:06:07.803936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 317/624] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:07 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:07.808620 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:07.809473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:07.817383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.818286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.819233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.819868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.871807 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:07.880476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-391fb514-143a-4e0b-b099-da277a9fbdd3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1272 microversion: 2.1 time: 0.201366 Nov 11 01:06:07.881721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 308/625] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:07 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:07.917297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:07.918314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:07.925845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.926294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.927113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:07.927860 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:07.990248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:07.999258 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:08.001612 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:08.002828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b9cf5cee-d6b4-44ee-8da2-d9497750d1ed tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.197864 Nov 11 01:06:08.003438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 318/626] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:07 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:08.099971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9505ab44-1603-4140-a117-925a424c0425 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.186064 Nov 11 01:06:08.100733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 309/627] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:07 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:06:08.463244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:08.464203 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:08.471669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:08.472110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:08.472876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:08.473327 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:08.506415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c1474bbd-2c17-40e0-bd00-9e43d4a1f4bd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Nov 11 01:06:08.506888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 319/628] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:06:08 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:08.820875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:08.821571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:08.828813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:08.829269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:08.830033 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:08.830461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:08.897762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:08.898375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:08.904153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:08.904605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:08.905399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:08.905838 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:08.998385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:09.006875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c007ec54-c6cf-4a36-b4f1-f73e43fb9046 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.190065 Nov 11 01:06:09.007473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 310/629] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:08 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:09.021792 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:09.022390 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:09.028232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:09.028672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:09.029432 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:09.029856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:09.065758 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:09.073379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-831fb3c0-663b-421c-9619-23e215780eba tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.179249 Nov 11 01:06:09.074045 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 320/630] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:08 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:09.112934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:09.113860 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:09.119951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:09.120403 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:09.121256 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:09.121829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:09.174694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:09.182850 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:09.184422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:09.185601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-94f5d785-1001-4251-8551-8f218d463258 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.167403 Nov 11 01:06:09.186181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 311/631] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:09 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:09.340991 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-db8640a8-a1a1-40bc-a533-da94317f7922 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 28774 microversion: 2.1 time: 0.231740 Nov 11 01:06:09.341575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 321/632] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:09 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 28774 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:06:09.520274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:09.521322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:09.528378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:09.528830 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:09.529623 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:09.530197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:09.564529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f76f4d0d-99f2-4345-a167-621bbc428746 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049506 Nov 11 01:06:09.565477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 312/633] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:06:09 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:10.024927 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:10.026459 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:10.034989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.035773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.036637 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.037106 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.091150 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:10.091758 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:10.098982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.099457 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.100329 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.100768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.215279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:10.224033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7d0fde1b-4271-47b5-9419-ba75045b9cac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.203746 Nov 11 01:06:10.224523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 322/634] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:10 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:10.229228 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:10.229828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:10.236004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.236447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.237225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.237659 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.294577 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:10.301867 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-27f92f94-05e8-44b9-97d7-e5631897c036 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.214670 Nov 11 01:06:10.302748 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 313/635] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:10 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:10.352495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:10.353533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:10.359413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.359950 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.360806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.361318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.388060 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:10.397773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:10.399338 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:10.400563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c0525097-228d-4121-9536-bcd3561a2c7e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.175097 Nov 11 01:06:10.401309 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 323/636] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:10 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:10.576121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:10.577121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:10.584178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.584627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.585406 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.585841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.617526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-572c0818-289d-4439-b7a7-c44158bd8b80 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Nov 11 01:06:10.618288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 324/637] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:06:10 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:10.758407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a34eb66-787a-4b60-9861-b46cae9070e6", "device": "/dev/sdb"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:10.759971 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:10.765952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.766553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:10.767456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:10.767887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:30.882159 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a716cd95-4699-499e-bee8-76b93b242b8a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 200 len: 38406 microversion: 2.1 time: 20.533011 Nov 11 01:06:30.883126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 314/638] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:10 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 38406 bytes in 20535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:06:30.888594 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:30.889294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:30.896935 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:30.897382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:30.898163 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:30.898596 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.012630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e1c93e81-1fdb-4c4e-9fd0-dbb3121a62ec tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "POST /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.256652 Nov 11 01:06:31.013780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 325/639] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:06:10 2021] POST /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5/os-volume_attachments => generated 194 bytes in 20260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:06:31.019051 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:31.019809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:31.028785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.029549 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.030565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.031255 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.040473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:31.053813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4bcfcb11-83fe-4d03-9827-bb33516be1c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.169515 Nov 11 01:06:31.055151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 315/640] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:30 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:31.060998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:31.061789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:31.068082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.068734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.069612 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.070082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.248323 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:31.256397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cf7a8edd-4d13-4639-a4d0-f80371ffc9cf tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.241407 Nov 11 01:06:31.266009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 326/641] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:31 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:31.266377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:31.266498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:31.266498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:31.269576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.270020 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.270806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.271240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.271448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:31.272944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:31.274100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fd5f6c38-9240-4a5c-87d7-f72089748363 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.217873 Nov 11 01:06:31.274666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 316/642] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:31 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:31.289681 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:31.290177 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:31.296836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.297352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.298238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:31.298658 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:31.303665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-86fe09b7-98a3-48e3-9f71-aa10068297e7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045278 Nov 11 01:06:31.305731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 327/643] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:06:31 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:06:31.324631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cd4f6390-6ba7-43d9-95ee-4abde9e49b09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/ips" status: 200 len: 146 microversion: 2.1 time: 0.048897 Nov 11 01:06:31.325471 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 317/644] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Nov 11 01:06:31 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:32.071984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:32.072523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:32.079491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:32.079937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:32.080867 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:32.081137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:32.213770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:32.222661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1320fb91-68b0-4310-aa12-900db8cbf07b tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.154435 Nov 11 01:06:32.223259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 328/645] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:32 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:32.273440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:32.274060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:32.280673 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:32.281122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:32.281894 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:32.282328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:32.291416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:32.292019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:32.298235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:32.298676 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:32.299470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:32.299902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:32.474324 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:32.482034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-143834ec-56ce-4437-a961-a4a8b4900942 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.212187 Nov 11 01:06:32.482161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:32.482763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 318/646] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:32 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:32.490420 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:32.492252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:32.493411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a772965f-a5d7-4707-8bfd-17e23733defb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.205592 Nov 11 01:06:32.493963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 329/647] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:32 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:33.239693 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:33.240305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:33.246498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.246979 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.247762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.248199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.378733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:33.386388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b7e79383-3044-4a63-9217-0863cd64ddc3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.150334 Nov 11 01:06:33.387584 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 319/648] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:33 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:33.499413 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:33.500151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:33.506244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.506707 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.507500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.507933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.512839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:33.512839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:33.519669 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.520179 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.521023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.521573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.723789 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:33.726929 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:33.736032 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-67e0b73d-5694-4dd4-91e9-587827fba68b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.241138 Nov 11 01:06:33.736289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:33.737489 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 330/649] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:33 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:33.738289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:33.739849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2054a50a-f5a3-4eb7-b426-bf9f9246339f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.231533 Nov 11 01:06:33.753529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 320/650] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:33 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:33.754322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:33.755030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:33.761614 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.762467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.763447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.764000 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.789470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:06:33.866201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9d9141bb-cdba-4b3c-9c3e-e3071b99e6e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 204 len: 0 microversion: 2.1 time: 0.116569 Nov 11 01:06:33.866792 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 331/651] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:06:33 2021] DELETE /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:06:33.874691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:33.875340 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:33.881219 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.881667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:33.882436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:33.882873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.013674 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:34.020937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c750e44a-33e0-42c3-9ed8-a25ada19a9e4 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1513 microversion: 2.1 time: 0.149945 Nov 11 01:06:34.021502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 321/652] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:33 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:34.404684 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:34.405371 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:34.411122 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.411572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.412350 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.412781 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.544599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:34.552358 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bbc17c9a-9060-440c-9e3b-132298ebf643 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.152231 Nov 11 01:06:34.552983 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 332/653] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:34 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:34.752980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:34.753585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:34.759645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:34.759972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.760282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:34.760410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.761176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.761608 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.766716 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.767209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.767985 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.768419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.960850 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:34.961361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:34.974222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b9ee3508-5f23-48e6-bca5-60b39411393c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.224781 Nov 11 01:06:34.974958 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:34.975766 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 322/654] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:34 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:34.977249 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:34.979083 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-12748f6b-6a5b-4d51-bb41-27d10a3a9507 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.223119 Nov 11 01:06:34.980092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 333/655] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:34 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:34.981940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5cc127d-7269-498d-ada7-1258a4dddfaa"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:34.983161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:34.989031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.989855 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:34.990971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:34.991562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:35.038333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:35.038961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:35.045864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:35.046340 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:35.047167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:35.047738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:35.190665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:35.198211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e2510a93-1d8a-488b-b1d0-e69fec827022 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1513 microversion: 2.1 time: 0.163492 Nov 11 01:06:35.199178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 334/656] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:35 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:35.289750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dafff2d6-f222-4904-bb3f-dd5a8729c8bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312526 Nov 11 01:06:35.290483 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 323/657] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:06:34 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:35.569407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:35.570027 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:35.577304 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:35.577685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:35.578461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:35.578896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:35.711344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:35.719291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ab5b9262-d79d-4051-84bc-1bc07f250047 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.153474 Nov 11 01:06:35.719852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 335/658] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:35 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:35.998758 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:35.999523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:35.999949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:36.000654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:36.005411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.005931 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.006767 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.006885 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.007328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.007452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.008110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.008544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.205831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:36.209637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:36.214020 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cb8c85fd-39ac-404c-b2e3-df073c91b0d3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.219105 Nov 11 01:06:36.215408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 336/659] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:35 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:36.220427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:36.220641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:36.221030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:36.221995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:36.223200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ef16cacb-d9f6-4583-bd38-066bc0f04fa3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.228156 Nov 11 01:06:36.223898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 324/660] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:35 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:36.226755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.227225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.227992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.228421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.358894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:36.366669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a0f92159-afff-44d8-8fed-83e89c87d210 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1513 microversion: 2.1 time: 0.149652 Nov 11 01:06:36.367337 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 337/661] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:36 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:36.735972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:36.736497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:36.742926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.743671 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.744447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:36.744876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:36.878561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:36.886488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4bc75d72-e435-4c4e-99a6-d5a9022cadc4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.154238 Nov 11 01:06:36.887845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 325/662] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:36 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:37.232599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:37.233183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:37.239498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.239937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.240710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.241133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.241239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:37.241836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:37.248934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.249378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.250151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.250583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.435422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:37.439722 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:37.447229 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cc67729c-0b40-4cc1-82ab-a53e51c4d1aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.219282 Nov 11 01:06:37.447794 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 338/663] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:37 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:37.451844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:37.452356 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:37.452995 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:37.453566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:37.454733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4c1c1cab-ab71-4483-9949-727ef07d081d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.217158 Nov 11 01:06:37.455597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 326/664] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:37 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:37.459129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.459582 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.460357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.460905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.590506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:37.597755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-12357433-80ea-4c4a-b7bf-37013ef9c8fe tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1513 microversion: 2.1 time: 0.148917 Nov 11 01:06:37.598324 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 339/665] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:37 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:37.904887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:37.905502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:37.911962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.912420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:37.913225 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:37.913703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.002675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-71b6a6c7-4faf-44fb-a728-199e91b8c5f2 req-1d496aa0-41ae-4caf-a47a-a2ab3d2a76fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe6d69-769b-4ce1-b14e-8edaba02d820", "name": "network-vif-deleted", "tag": "f404b098-501c-4bdf-9b3e-0b0821536e87"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:38.005267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:06:38.005267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:06:38.020031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-71b6a6c7-4faf-44fb-a728-199e91b8c5f2 req-1d496aa0-41ae-4caf-a47a-a2ab3d2a76fa service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.020483 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-71b6a6c7-4faf-44fb-a728-199e91b8c5f2 req-1d496aa0-41ae-4caf-a47a-a2ab3d2a76fa service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.032237 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-71b6a6c7-4faf-44fb-a728-199e91b8c5f2 req-1d496aa0-41ae-4caf-a47a-a2ab3d2a76fa service nova] Creating event network-vif-deleted:f404b098-501c-4bdf-9b3e-0b0821536e87 for instance a0fe6d69-769b-4ce1-b14e-8edaba02d820 on hv-cinder-81708 Nov 11 01:06:38.037045 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-71b6a6c7-4faf-44fb-a728-199e91b8c5f2 req-1d496aa0-41ae-4caf-a47a-a2ab3d2a76fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038037 Nov 11 01:06:38.040744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 340/666] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:06:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:06:38.085464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:38.094447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8122aa4e-36bc-4664-969d-02ad0647c4c9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.193842 Nov 11 01:06:38.095293 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 327/667] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:37 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:38.464545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:38.465754 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:38.471918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.472359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.472644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:38.473265 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.473346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:38.473547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.480137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.481157 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.481941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.482374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.670660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:38.678827 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:38.679765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:38.680357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:38.681525 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fc733710-8ee2-48b2-bc7e-67aa1c576473 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.212589 Nov 11 01:06:38.687817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 328/668] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:38 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:38.687817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:38.687817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:38.688158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6a04afae-0577-418d-8674-99c3f4faf82c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.227432 Nov 11 01:06:38.688242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 341/669] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:38 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:38.693543 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.694124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.695080 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.695599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.726834 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:38.727342 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:38.727793 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'fault' on Instance uuid a0fe6d69-769b-4ce1-b14e-8edaba02d820 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:06:38.766512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:38.773654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-59e3d6ec-2f6f-4bb8-8524-9afed779f983 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 200 len: 1307 microversion: 2.1 time: 0.090646 Nov 11 01:06:38.774210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 329/670] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:38 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:39.112158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:39.113018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:39.119010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.119465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.120245 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.120678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.208434 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-5b35d870-8529-4476-bf21-f1c211dcecc5 req-352ae7ad-b932-4176-9a06-2bdf058494e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "name": "network-vif-plugged", "status": "completed", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:39.210288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:06:39.210288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:06:39.217760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5b35d870-8529-4476-bf21-f1c211dcecc5 req-352ae7ad-b932-4176-9a06-2bdf058494e8 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.218287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5b35d870-8529-4476-bf21-f1c211dcecc5 req-352ae7ad-b932-4176-9a06-2bdf058494e8 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.231646 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-5b35d870-8529-4476-bf21-f1c211dcecc5 req-352ae7ad-b932-4176-9a06-2bdf058494e8 service nova] Creating event network-vif-plugged:e56a395c-77ef-4622-a62e-fedb27621bdb for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 on hv-cinder-81708 Nov 11 01:06:39.236582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-5b35d870-8529-4476-bf21-f1c211dcecc5 req-352ae7ad-b932-4176-9a06-2bdf058494e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031838 Nov 11 01:06:39.237568 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 330/671] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:06:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:39.259063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:39.268159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-16e93746-e258-4c94-9f93-54676566ae70 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.159714 Nov 11 01:06:39.268921 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 342/672] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:39 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:39.702367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:39.703119 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:39.708589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:39.709039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:39.709738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.710186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.711414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.712044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.716559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.717031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.717827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.718270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.906509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:39.910635 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:39.914013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9d51da23-1d40-4179-8859-2fb66aa6b03e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.212968 Nov 11 01:06:39.914590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 343/673] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:39 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:39.918843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:39.919954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:39.920092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a0fe6d69-769b-4ce1-b14e-8edaba02d820] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:39.921390 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:39.922628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-661ba18e-e35f-4fc2-a994-96430c245094 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.226207 Nov 11 01:06:39.923357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 331/674] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:39 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:39.926501 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.926974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.927766 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:39.928181 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:39.941560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] HTTP exception thrown: Instance a0fe6d69-769b-4ce1-b14e-8edaba02d820 could not be found. Nov 11 01:06:39.942146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Returning 404 to user: Instance a0fe6d69-769b-4ce1-b14e-8edaba02d820 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:06:39.942977 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f1878ab6-b39d-448d-8e25-9c12b7a99ad2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820" status: 404 len: 111 microversion: 2.1 time: 0.027458 Nov 11 01:06:39.943524 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 344/675] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:39 2021] GET /compute/v2.1/servers/a0fe6d69-769b-4ce1-b14e-8edaba02d820 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:06:40.284829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:40.285430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:40.291037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:40.291480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:40.292239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:40.292663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:40.421335 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:40.428933 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-49e431d5-7765-4b40-8589-a504cb994fe2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.147749 Nov 11 01:06:40.429498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 332/676] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:40 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:40.931196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:40.931824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:40.939086 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:40.939526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:40.940101 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:40.940532 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:40.940707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:40.940840 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:40.946974 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:40.947440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:40.948213 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:40.948645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.365385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:41.368909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:41.373523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fef22b17-012c-493e-9d70-1838714d6af0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.446056 Nov 11 01:06:41.374274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 345/677] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:40 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:41.377903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:41.378576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:41.379103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:41.379419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:41.380633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ba119d9e-4833-4df4-8d62-3e451c81c656 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.444166 Nov 11 01:06:41.381330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 333/678] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:40 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:41.385200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:41.385658 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.386445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:41.387581 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.411330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:06:41.446456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:41.447083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:41.453874 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:41.454357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.455327 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:41.455769 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.484156 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e69f3c55-55d5-41b5-94a4-3160347e7c19 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 204 len: 0 microversion: 2.1 time: 0.108680 Nov 11 01:06:41.487719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 346/679] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:06:41 2021] DELETE /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:06:41.492907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:41.493592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:41.500279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:41.507038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.507876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:41.508308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:41.632141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:41.640908 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c1083568-8caf-4246-afda-bc1813ed686d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.198061 Nov 11 01:06:41.641666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 334/680] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:41 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:41.678604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:41.686552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5c26f2e9-f243-4497-b201-8ca26bb3ab62 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.197577 Nov 11 01:06:41.687141 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 347/681] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:41 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:42.389706 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:42.390318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:42.396899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.397356 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.398132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.398574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.399086 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:42.399701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:42.406041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.406493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.407299 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.407732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.601249 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:42.604819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:42.610865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:42.612391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:42.612590 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3ea88e66-24f6-46c9-8811-47aaff269bcd tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.226727 Nov 11 01:06:42.613158 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 335/682] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:42 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:42.613547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cbe265e2-662f-4163-913b-5f0806deba23 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.218084 Nov 11 01:06:42.614315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 348/683] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:42 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:42.657640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:42.658268 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:42.664185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.664625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.665391 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.665818 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.706416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:42.707075 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:42.713683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.714136 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.715936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:42.716232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:42.831864 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:42.840351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e1a594bf-581e-441a-a237-75dbe86444bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.185438 Nov 11 01:06:42.841182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 336/684] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:42 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:42.893269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:42.900900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c742ff5e-1ba7-41bc-912d-cd893d01b2dd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.199276 Nov 11 01:06:42.901532 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 349/685] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:42 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:43.630795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:43.631488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:43.632527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:43.633190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:43.638431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.638878 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.639677 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.640109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.640630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.641074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.641845 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.642310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.830439 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:43.837344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:43.837709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-29672a5b-8d1c-4094-9b70-549079ba5b42 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.211475 Nov 11 01:06:43.838279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 337/686] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:43 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:43.845933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:43.847519 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:43.848668 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ff6d995d-82cd-4fba-8e97-97fe80d2f875 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.219801 Nov 11 01:06:43.849212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 350/687] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:43 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:43.857843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:43.858447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:43.864175 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.864621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.865390 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.865823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.920543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:43.921152 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:43.927707 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.928159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:43.929275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:43.930074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:44.031171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:44.039213 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-174adf7e-f4c0-458e-b2fa-86f72643af99 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.185238 Nov 11 01:06:44.039780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 338/688] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:43 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:44.094588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:44.103037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9ddbae93-21ae-4721-b379-710ec0ace13d tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.186793 Nov 11 01:06:44.103607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 351/689] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:43 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:44.853602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:44.854206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:44.861965 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:44.862279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:44.863097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:44.863671 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:44.868133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:44.868857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:44.876211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:44.876780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:44.877636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:44.878295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:45.098331 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:45.107221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f02e06df-d91e-4cfa-addf-12e541feab80 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1260 microversion: 2.1 time: 0.257158 Nov 11 01:06:45.107983 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 339/690] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:44 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:45.112999 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:45.121760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:45.122386 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:45.128648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:45.128850 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:45.129093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:45.129888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:45.130309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:45.132832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:45.135839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c3c0c20a-b1f8-4912-a170-eeda99a23ada tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.271271 Nov 11 01:06:45.137033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 352/691] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:44 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:45.152788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:45.153470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:45.161145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:45.161793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:45.162569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:45.163191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:45.353844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:45.357520 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:45.363244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b3a4b056-868a-4edb-be8b-fd67ff30fbda tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.245553 Nov 11 01:06:45.364138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 340/692] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:45 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:45.364795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-58310393-927a-40da-8b81-a31368b656f0 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.221796 Nov 11 01:06:45.365520 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 353/693] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:45 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:46.123611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:46.124272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:46.130553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.131044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.131823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.132258 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.156008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:46.156617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:46.162971 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.163522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.164319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.164755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.347198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.355191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c009b31a-5f34-4f3b-a7cd-442ea88ee5d1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1443 microversion: 2.1 time: 0.235523 Nov 11 01:06:46.356291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 341/694] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:46 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1443 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:46.371216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.373918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:46.374527 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:46.380939 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.381107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.381476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.382246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.382608 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.382729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.383811 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3181a4cd-dc9f-43e3-b0fb-98965c710588 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.232874 Nov 11 01:06:46.384370 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 354/695] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:46 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:46.389319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:46.389925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:46.395553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.396004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.396785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.397227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.580558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.586030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.590917 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-633aba23-42a1-4cde-a718-efb0383a089f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1443 microversion: 2.1 time: 0.222198 Nov 11 01:06:46.591620 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 342/696] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:46 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1443 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:46.594650 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-03164253-135e-4a2a-a05b-8dca56b2f8c0 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.209208 Nov 11 01:06:46.595342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 355/697] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:46 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:46.597240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:46.597835 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:46.605238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.606450 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.607292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:46.607749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:46.780575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:46.787842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ba307a4a-56f2-4697-9e8c-3eddb0196a8a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.194235 Nov 11 01:06:46.788414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 343/698] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:46 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:47.404544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:47.405115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:47.412529 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:47.413203 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:47.414147 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:47.414719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:47.547271 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:47.555465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:47.556941 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:47.558244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-75a1e824-9d1b-4fd4-9f0d-5d534bb7451b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.157952 Nov 11 01:06:47.558820 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 356/699] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:47 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:47.612760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:47.613376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:47.619662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:47.620118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:47.620966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:47.621443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:47.757904 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:47.766513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2a67384e-b49b-43a1-b604-c0a5cd19f5f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.157431 Nov 11 01:06:47.767346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 344/700] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:47 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:47.804011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:47.804647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:47.810706 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:47.811189 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:47.811969 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:47.812401 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:47.955014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:47.966022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2d87d490-b2dc-44ca-94ce-2377404693b7 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.165409 Nov 11 01:06:47.966605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 357/701] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:47 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:48.577290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:48.577823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:48.583759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.584208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:48.584994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.585431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:48.692526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-ce4321d5-0445-48af-a9b8-aa2f4569a3ee req-e7d4acbc-72ac-4280-abcd-2c95b25a32fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:48.694305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:06:48.694305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:06:48.704456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-ce4321d5-0445-48af-a9b8-aa2f4569a3ee req-e7d4acbc-72ac-4280-abcd-2c95b25a32fd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.704899 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-ce4321d5-0445-48af-a9b8-aa2f4569a3ee req-e7d4acbc-72ac-4280-abcd-2c95b25a32fd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:48.717318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-ce4321d5-0445-48af-a9b8-aa2f4569a3ee req-e7d4acbc-72ac-4280-abcd-2c95b25a32fd service nova] Creating event network-changed:e56a395c-77ef-4622-a62e-fedb27621bdb for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 on hv-cinder-81708 Nov 11 01:06:48.722263 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-ce4321d5-0445-48af-a9b8-aa2f4569a3ee req-e7d4acbc-72ac-4280-abcd-2c95b25a32fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Nov 11 01:06:48.722864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 358/702] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:06:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:48.737343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:48.746386 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:48.747921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:48.749087 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c6d8cf1e-b89d-4a17-8dda-9591863736be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.176412 Nov 11 01:06:48.749645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 345/703] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:48 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:48.783764 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:48.784489 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:48.790389 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.790851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:48.791647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.792081 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:48.922339 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:48.930440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fd9aaab8-9689-4a05-a4c2-f7c80abc57c8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.150653 Nov 11 01:06:48.931040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 359/704] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:48 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:48.983109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:48.984109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:48.991518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.992066 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:48.993210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:48.993720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:49.125572 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:49.132880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-44fcd0cd-8ec3-4892-95ef-397a0e0f16fb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.153513 Nov 11 01:06:49.133525 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 346/705] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:48 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:49.768336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:49.768954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:49.775349 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:49.775800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:49.776571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:49.777175 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:49.915250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:49.924043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:49.925454 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:49.926606 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cc3fe6da-355f-4d02-9119-920da528fc6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.162399 Nov 11 01:06:49.927500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 360/706] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:49 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:49.947654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:49.948265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:49.954511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:49.954978 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:49.955979 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:49.956606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:50.098175 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:50.107210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bf839b8f-21e9-4419-9a41-aecdd9b4d7bb tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.163095 Nov 11 01:06:50.107784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 347/707] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:49 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:50.149506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:50.150216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:50.156175 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:50.156704 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:50.157480 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:50.157903 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:50.303580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:50.310712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9dbad96d-ac40-4548-bdce-9b61aef99125 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.164901 Nov 11 01:06:50.312210 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 361/708] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:50 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:50.945504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:50.946024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:50.952450 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:50.953175 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:50.953693 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:50.954126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:51.083209 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:51.092305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:51.093789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:51.094974 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f123c3a0-447b-4206-b03e-764f340eb719 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.153239 Nov 11 01:06:51.095502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 348/709] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:50 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:51.124711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:51.125316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:51.131731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:51.132179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:51.132956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:51.133389 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:51.264033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:51.271629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fb6b9612-eb74-4d4d-a622-cc4eef74102f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.150626 Nov 11 01:06:51.272204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 362/710] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:51 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:51.327696 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:51.328290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:51.334083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:51.334520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:51.335316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:51.335743 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:51.471869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:51.479006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9dac6b48-a424-40e2-b043-375b6cc0fb06 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.155386 Nov 11 01:06:51.479562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 349/711] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:51 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:52.113393 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:52.114058 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:52.119813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.120261 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.121872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.122313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.256609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:52.265229 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:52.266934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:52.268232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-648777ff-d45d-47b0-abe2-86c89731ad9f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.158619 Nov 11 01:06:52.269273 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 363/712] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:52 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:52.289225 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:52.291752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:52.296940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.297387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.298183 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.298599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.432387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:52.440685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d0d28ee8-74d3-40ba-bfce-d6eb349a3a84 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.155131 Nov 11 01:06:52.441252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 350/713] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:52 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:52.495293 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:52.496294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:52.502027 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.502472 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.503264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.503695 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.631173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:52.638522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9550c539-4e6c-476e-8d89-961eb8ac477e tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.146856 Nov 11 01:06:52.639125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 364/714] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:52 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:52.876640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-80524ebf-33d4-4174-b5f7-44abda549c6d req-09fe18a4-fc7f-4f4f-adab-10d1d3cc58ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "name": "network-vif-plugged", "status": "completed", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:52.878349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:06:52.878349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:06:52.885593 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-80524ebf-33d4-4174-b5f7-44abda549c6d req-09fe18a4-fc7f-4f4f-adab-10d1d3cc58ae service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:52.886548 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-80524ebf-33d4-4174-b5f7-44abda549c6d req-09fe18a4-fc7f-4f4f-adab-10d1d3cc58ae service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:52.898006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-80524ebf-33d4-4174-b5f7-44abda549c6d req-09fe18a4-fc7f-4f4f-adab-10d1d3cc58ae service nova] Creating event network-vif-plugged:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:06:52.903456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-80524ebf-33d4-4174-b5f7-44abda549c6d req-09fe18a4-fc7f-4f4f-adab-10d1d3cc58ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 Nov 11 01:06:52.904040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 351/715] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:06:53.288328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:53.288928 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:53.295457 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:53.295900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:53.296667 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:53.297094 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:53.433965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:53.443105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:53.445319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:53.446741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6286fca8-136f-48ea-bee6-2963debe2cb4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.162102 Nov 11 01:06:53.447688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 365/716] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:53 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:53.458414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:53.459138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:53.465603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:53.466048 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:53.466810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:53.467349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:53.597151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:53.606183 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-484294bc-0b2f-4eb4-8a5c-ea7accfadb51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.150850 Nov 11 01:06:53.606750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 352/717] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:53 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:53.655384 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:53.655989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:53.661642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:53.662078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:53.662847 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:53.663298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:53.793425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:53.800826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0ba48353-cf43-474d-b406-7110e1b290fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.149616 Nov 11 01:06:53.801394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 366/718] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:53 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:54.466410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:54.467040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:54.473294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:54.473738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:54.474509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:54.474964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:54.613930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:54.622253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:54.622864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:54.623513 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:54.623784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:54.625051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1a5ff663-fc95-458d-97ff-2ef18f838653 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.162916 Nov 11 01:06:54.625489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 353/719] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:54 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:54.629861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:54.630303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:54.631106 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:54.631540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:54.768588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:54.777615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-30b36f50-5c21-45a1-b9cc-1e54bdcfdf1e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.158408 Nov 11 01:06:54.778182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 367/720] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:54 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:54.818196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:54.818808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:54.824575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:54.825048 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:54.825814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:54.826246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:54.968930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:54.977180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1d178bb3-ec21-4add-a3bd-95980cc0be72 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1515 microversion: 2.1 time: 0.162577 Nov 11 01:06:54.977747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 354/721] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:54 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:55.391652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7fb2d489-3640-4c76-a6a4-c2b91239dfa7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:55.398834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fb2d489-3640-4c76-a6a4-c2b91239dfa7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.399321 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fb2d489-3640-4c76-a6a4-c2b91239dfa7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.465258 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7fb2d489-3640-4c76-a6a4-c2b91239dfa7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Going to try to stop instance {{(pid=116015) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 11 01:06:55.483427 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-d113bd7b-4b17-4b50-9db7-36990d51c4fd req-d23d5765-2616-4c24-a1f2-54ffc1249c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea", "name": "network-vif-deleted", "tag": "ff3dd580-7793-4eca-a64b-c7e41005425d"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:55.485018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:06:55.485018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:06:55.492612 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d113bd7b-4b17-4b50-9db7-36990d51c4fd req-d23d5765-2616-4c24-a1f2-54ffc1249c66 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.493060 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d113bd7b-4b17-4b50-9db7-36990d51c4fd req-d23d5765-2616-4c24-a1f2-54ffc1249c66 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.506251 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-d113bd7b-4b17-4b50-9db7-36990d51c4fd req-d23d5765-2616-4c24-a1f2-54ffc1249c66 service nova] Creating event network-vif-deleted:ff3dd580-7793-4eca-a64b-c7e41005425d for instance 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea on hv-cinder-81708 Nov 11 01:06:55.512407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-d113bd7b-4b17-4b50-9db7-36990d51c4fd req-d23d5765-2616-4c24-a1f2-54ffc1249c66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Nov 11 01:06:55.513217 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 355/722] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:06:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:06:55.515616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7fb2d489-3640-4c76-a6a4-c2b91239dfa7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.128171 Nov 11 01:06:55.516209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 368/723] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:55 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:06:55.524438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:55.525133 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:55.531908 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.532356 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.533129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.533561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.651221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:55.651221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:55.657984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.657984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.657984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.658447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.695072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:55.711199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8fda78a4-6e79-4644-9834-83f2a327f877 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.189402 Nov 11 01:06:55.713967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 356/724] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:55 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:55.795690 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:55.796440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:55.802480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.803036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.804031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:55.804789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:55.822050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:55.831114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:55.832597 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:55.833756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6d569fc1-3fad-4fd3-bd0c-9c56a8dd6f0a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.194293 Nov 11 01:06:55.834316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 369/725] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:55 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:55.935775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:55.943346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-21474944-edcd-4a12-b764-25eaaa990103 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.152486 Nov 11 01:06:55.943922 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 357/726] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:55 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:55.999219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:56.000300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:56.006433 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.006881 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.007688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.008121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.086153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:56.095953 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4a197765-c909-4a80-a5f7-b36d4950f8d2 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1473 microversion: 2.1 time: 0.102978 Nov 11 01:06:56.096528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 370/727] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:55 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1473 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:56.732318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:56.732831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:56.738970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.739436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.740193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.740619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.852705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:56.853318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:56.859990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.860437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.861216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.861646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.874907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:56.882619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3c94ec2e-feb2-4518-b4d4-ce8b367d334a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.154561 Nov 11 01:06:56.883221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 358/728] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:56 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:56.961272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:56.961914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:56.969726 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.969726 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.970464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:56.970895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:56.997411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:57.005652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:57.007149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:57.008834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-201f7f28-3dca-43fb-a17d-47fb42c90019 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.159796 Nov 11 01:06:57.009399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 371/729] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:56 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:06:57.104190 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:57.113647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:57.114104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-aa2f7a2a-5796-4967-b94b-8c7941a25480 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1567 microversion: 2.1 time: 0.156385 Nov 11 01:06:57.114244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:57.114746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 359/730] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:56 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:57.119987 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.120972 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.121441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.121872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.152885 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.153328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.153774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'fault' on Instance uuid 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:06:57.194179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:57.202296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fa08ecd1-caf3-4c28-b8e9-e053b9d228cd tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 200 len: 1308 microversion: 2.1 time: 0.092310 Nov 11 01:06:57.202871 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 372/731] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:57 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:57.869338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:57.869831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:57.876685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.877136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.877902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.878339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.899350 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:57.899956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:57.906057 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.906503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.907307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:57.907741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:57.988218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'services' on Instance uuid 7cf1d23b-4934-4920-b304-0958f87dd3c5 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:06:58.061939 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.070205 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-99a8f231-6b2d-4773-bdec-c14190e7e9b9 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5/os-volume_attachments/4a34eb66-787a-4b60-9861-b46cae9070e6" status: 202 len: 0 microversion: 2.1 time: 0.204406 Nov 11 01:06:58.070705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f19634f3-933e-45a0-873b-1645a83938a0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.174870 Nov 11 01:06:58.071174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 360/732] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:06:57 2021] DELETE /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5/os-volume_attachments/4a34eb66-787a-4b60-9861-b46cae9070e6 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:06:58.080027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.080994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.082531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 373/733] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:57 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:58.098704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.099459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.100351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.100780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.131181 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.132095 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.140592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.141158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.141959 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.142393 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.315234 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.328450 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.329991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.331199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6b87b8c4-3475-4c01-a5ea-5e74d4589c87 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1809 microversion: 2.20 time: 0.258626 Nov 11 01:06:58.331761 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 361/734] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:58 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:58.336346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.336936 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.343596 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.344246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.345317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.345756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.355474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.359960 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] HTTP exception thrown: Instance 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea could not be found. Nov 11 01:06:58.360558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Returning 404 to user: Instance 3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:06:58.361400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a5078908-baab-4406-99a3-ae82e8b89d84 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea" status: 404 len: 111 microversion: 2.1 time: 0.028523 Nov 11 01:06:58.362230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 362/735] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:58 2021] GET /compute/v2.1/servers/3e6bb9f2-42bc-4fde-b3d3-af6448d1c2ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:06:58.367954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b8849442-b49f-4358-8c27-099d96070a62 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1547 microversion: 2.1 time: 0.241211 Nov 11 01:06:58.368784 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 374/736] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:58 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:58.369753 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.370371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.376860 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.377490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.378457 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.379077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.385533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.386642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.392682 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.393134 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.393910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.394348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.406459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:06:58.480226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] HTTP exception thrown: Cannot 'detach_volume' instance 45620e84-de01-477d-a818-263dae68f119 while it is in vm_state rescued Nov 11 01:06:58.481365 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Returning 409 to user: Cannot 'detach_volume' instance 45620e84-de01-477d-a818-263dae68f119 while it is in vm_state rescued {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:06:58.482768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0f378076-09ca-46c7-b438-f2b09be25a9a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments/87572d7d-87f3-43e0-9265-62d4efcd907d" status: 409 len: 152 microversion: 2.1 time: 0.101397 Nov 11 01:06:58.487201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 375/737] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:06:58 2021] DELETE /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments/87572d7d-87f3-43e0-9265-62d4efcd907d => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 11 01:06:58.490110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bc484826-99e3-4bea-86d6-da99b5d0eeec tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 204 len: 0 microversion: 2.1 time: 0.123630 Nov 11 01:06:58.493412 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 363/738] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:06:58 2021] DELETE /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:06:58.493541 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:06:58.493541 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.500422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.500625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.501042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.501169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.501888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.502332 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.507372 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.507825 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.508790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.509581 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.579557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b574a3a1-aff9-4554-bd0d-ff21b9d56e6c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action" status: 202 len: 0 microversion: 2.1 time: 0.090036 Nov 11 01:06:58.579557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 376/739] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:06:58 2021] POST /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:06:58.587514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:58.588209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:58.594723 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.595296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.596217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:58.596681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:58.680906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.688790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c9e96a2a-8fd0-4fb9-8e47-7da92e884fcb tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1514 microversion: 2.1 time: 0.193499 Nov 11 01:06:58.689458 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 364/740] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:58 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:58.749041 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:58.756919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b7da3755-973d-4a22-92cb-fcf003dbc003 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1555 microversion: 2.1 time: 0.173060 Nov 11 01:06:58.757699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 377/741] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:58 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:06:59.088735 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:59.090408 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:59.096828 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.097275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.098048 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.098485 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.300075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:59.308230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c7563add-5990-4009-b905-e3523035a825 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.222611 Nov 11 01:06:59.309203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 365/742] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:59 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:59.351346 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:59.351945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:59.358101 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.358542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.359341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.359769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.497573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:59.505682 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:59.507211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:59.508364 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-aa8df962-d8d4-4ff6-a058-ee4ba06092f9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1796 microversion: 2.20 time: 0.161414 Nov 11 01:06:59.508923 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 378/743] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:06:59 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1796 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:06:59.706468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:59.707120 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:59.712951 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.713397 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.714240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.714966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.774655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:06:59.775698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:06:59.782050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.782493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.783335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:06:59.783785 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:06:59.882180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:59.890348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-954d7a94-3970-4cce-86db-7becfeab3c83 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1514 microversion: 2.1 time: 0.187490 Nov 11 01:06:59.891023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 366/744] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:59 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:06:59.944161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:06:59.952136 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f79c99a8-c1cd-458a-b9dc-f34e5d1dbf5f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1555 microversion: 2.1 time: 0.181663 Nov 11 01:06:59.952719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 379/745] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:06:59 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:00.237311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:00.237808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:00.243881 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.244322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.245109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.245604 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.269749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:07:00.329521 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:00.330219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:00.336286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.336734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.337548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.338012 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.341840 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-346dde67-60ea-4efc-9f2c-6b80809e55f2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 204 len: 0 microversion: 2.1 time: 0.107854 Nov 11 01:07:00.342422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 367/746] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:07:00 2021] DELETE /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:07:00.350757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:00.351492 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:00.357792 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.358297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.359322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.359819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.541002 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:00.545448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:00.549935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1d74114a-bd1f-4b65-91ba-b995ebf807f6 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.224205 Nov 11 01:07:00.550514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 380/747] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:00 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:00.552815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dd50d5fb-dc7c-42cf-b50e-626abc5083cf tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1515 microversion: 2.1 time: 0.206050 Nov 11 01:07:00.553370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 368/748] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:00 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:00.906955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:00.907579 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:00.913467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.913912 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.914678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.915146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.971564 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:00.972587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:00.978581 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.979065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:00.979859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:00.980492 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:01.079976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:01.087132 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1b47c29c-6152-40a9-b61b-d684ff600948 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1514 microversion: 2.1 time: 0.183801 Nov 11 01:07:01.087710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 381/749] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:00 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:01.140122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:01.147722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e921d5ef-d543-47ed-91ca-5f0469d1c83d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1555 microversion: 2.1 time: 0.182040 Nov 11 01:07:01.148279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 369/750] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:00 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:01.566570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:01.567221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:01.569077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:01.569681 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:01.573639 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:01.574424 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:01.574965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:01.575471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:01.575750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:01.576198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:01.576971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:01.577401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:01.773334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:01.776649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:01.784801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7979ef89-81e6-4c2a-90ca-f7286e5bd465 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1515 microversion: 2.1 time: 0.219200 Nov 11 01:07:01.784984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9170bd80-6be9-4804-a0a1-84a120ab3ea9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.221996 Nov 11 01:07:01.785580 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 370/751] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:01 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:01.787205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 382/752] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:01 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:02.103472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:02.104185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:02.110498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.110961 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.111742 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.112166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.164973 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:02.165580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:02.172801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.173315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.174620 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.175333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.357406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:02.364894 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9ca0892f-58cc-4a30-b895-e2eb8894da92 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1514 microversion: 2.1 time: 0.265043 Nov 11 01:07:02.365542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 371/753] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:02 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:02.439527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:02.447902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d03a0fe3-52b2-4795-bb31-bc8c3a2d77fa tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1555 microversion: 2.1 time: 0.286527 Nov 11 01:07:02.448500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 383/754] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:02 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:02.538865 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-5837f8ec-d8ad-4588-9e47-d2654650034d req-c85ebdf6-c88f-4cee-ab26-c5083b4528c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c78dbc5-446a-4880-b317-ba9b20304be9", "name": "network-vif-deleted", "tag": "bcc3a1f2-10cd-4afa-a834-eb618cd1d74c"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:02.540513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:02.540513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:07:02.550363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5837f8ec-d8ad-4588-9e47-d2654650034d req-c85ebdf6-c88f-4cee-ab26-c5083b4528c3 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.550804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5837f8ec-d8ad-4588-9e47-d2654650034d req-c85ebdf6-c88f-4cee-ab26-c5083b4528c3 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.562843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-5837f8ec-d8ad-4588-9e47-d2654650034d req-c85ebdf6-c88f-4cee-ab26-c5083b4528c3 service nova] Creating event network-vif-deleted:bcc3a1f2-10cd-4afa-a834-eb618cd1d74c for instance 6c78dbc5-446a-4880-b317-ba9b20304be9 on hv-cinder-81708 Nov 11 01:07:02.568544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-5837f8ec-d8ad-4588-9e47-d2654650034d req-c85ebdf6-c88f-4cee-ab26-c5083b4528c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Nov 11 01:07:02.569293 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 372/755] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:07:02.801492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:02.802191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:02.804038 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:02.804733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:02.808665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.809243 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.810039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.810476 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.810631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.811152 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:02.811929 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:02.812361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.007501 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:03.013536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:03.015461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e5ba366a-477a-4304-98ca-646a093f15f4 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1515 microversion: 2.1 time: 0.217719 Nov 11 01:07:03.016374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 384/756] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:02 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:03.022859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d9b86034-447e-4ecd-9239-0db7ba25dcfa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.223251 Nov 11 01:07:03.030482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 373/757] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:02 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:03.382834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:03.383487 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:03.390387 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.390832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.391632 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.392066 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.421391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.421830 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.422272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'fault' on Instance uuid 6c78dbc5-446a-4880-b317-ba9b20304be9 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:03.461125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:03.466099 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:03.466703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:03.469348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-04c4d97a-198c-4738-b1d4-5e5b947b2da1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 200 len: 1308 microversion: 2.1 time: 0.090163 Nov 11 01:07:03.469917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 385/758] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:03 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:03.472644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.473089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.473896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.474336 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.606089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:03.613944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-23593a6e-b6db-4f4d-960c-d1e6dc97506f tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1561 microversion: 2.1 time: 0.152405 Nov 11 01:07:03.614512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 374/759] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:03 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:03.681694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:03.682206 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:03.688637 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.689077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.689846 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.690270 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.769368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lazy-loading 'services' on Instance uuid 45620e84-de01-477d-a818-263dae68f119 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:03.837022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2136eda2-252d-4121-bbb6-443e59c73d7e tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments/87572d7d-87f3-43e0-9265-62d4efcd907d" status: 202 len: 0 microversion: 2.1 time: 0.158841 Nov 11 01:07:03.837865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 386/760] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:07:03 2021] DELETE /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments/87572d7d-87f3-43e0-9265-62d4efcd907d => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:07:03.846325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:03.847314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:03.853556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.854001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.854843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:03.855309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:03.885240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f4c45357-8f85-48ef-9ba7-f6ff1d9421f4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042637 Nov 11 01:07:03.885799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 375/761] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:07:03 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:07:04.033007 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:04.033759 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:04.040084 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.040354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:04.040562 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.041042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:04.041332 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.041763 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.047639 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.048089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.048869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.049305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.268469 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:04.272691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:04.276649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2eda969b-b336-4e6b-bfba-9370b10e6954 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.240060 Nov 11 01:07:04.277542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 376/762] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:04 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:04.280310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f1f9cce3-c386-483b-9fb3-95d767cd67a7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1515 microversion: 2.1 time: 0.251480 Nov 11 01:07:04.280982 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 387/763] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:04 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:04.486284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:04.486986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: 6c78dbc5-446a-4880-b317-ba9b20304be9] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:04.493029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.493549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.494385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.494880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.509772 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] HTTP exception thrown: Instance 6c78dbc5-446a-4880-b317-ba9b20304be9 could not be found. Nov 11 01:07:04.510350 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Returning 404 to user: Instance 6c78dbc5-446a-4880-b317-ba9b20304be9 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:07:04.511186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-afac7119-3b0e-4476-aced-2c76dc15c1d1 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9" status: 404 len: 111 microversion: 2.1 time: 0.028637 Nov 11 01:07:04.512171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 377/764] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:04 2021] GET /compute/v2.1/servers/6c78dbc5-446a-4880-b317-ba9b20304be9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:07:04.702091 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-1361f73b-2715-4918-b8c2-7f58f1afd20b req-6d7a12bc-c9ef-4324-80f2-b1bf61dc3a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf1d23b-4934-4920-b304-0958f87dd3c5", "name": "network-vif-deleted", "tag": "d6b56662-d64b-46ed-a321-18629bfb4927"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:04.708366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:04.708366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:07:04.717088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-1361f73b-2715-4918-b8c2-7f58f1afd20b req-6d7a12bc-c9ef-4324-80f2-b1bf61dc3a09 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.717525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-1361f73b-2715-4918-b8c2-7f58f1afd20b req-6d7a12bc-c9ef-4324-80f2-b1bf61dc3a09 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.728187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-1361f73b-2715-4918-b8c2-7f58f1afd20b req-6d7a12bc-c9ef-4324-80f2-b1bf61dc3a09 service nova] Creating event network-vif-deleted:d6b56662-d64b-46ed-a321-18629bfb4927 for instance 7cf1d23b-4934-4920-b304-0958f87dd3c5 on hv-cinder-81708 Nov 11 01:07:04.733855 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-1361f73b-2715-4918-b8c2-7f58f1afd20b req-6d7a12bc-c9ef-4324-80f2-b1bf61dc3a09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035438 Nov 11 01:07:04.734446 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 388/765] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:07:04.897202 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:04.898183 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:04.905108 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.905553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.906327 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:04.906764 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:04.935667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ea378d1e-e62b-48cc-b106-ebd2837ee701 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042116 Nov 11 01:07:04.936230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 378/766] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:07:04 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:07:05.294231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:05.295438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:05.296746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:05.297349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:05.303795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.304400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.304983 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.305378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.305497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.306101 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.306743 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.307584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.342629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.343249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.343709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'fault' on Instance uuid 7cf1d23b-4934-4920-b304-0958f87dd3c5 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:05.657284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:05.665499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-eef51376-b713-4462-bd1d-af925f5225d2 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 200 len: 1309 microversion: 2.1 time: 0.372323 Nov 11 01:07:05.675433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 379/767] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:05 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:05.682567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:05.683374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:05.689507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.689956 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.690814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.691275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.725819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:07:05.747575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:05.756851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d58d4326-4f10-4da2-a6ec-52c392870a08 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.466508 Nov 11 01:07:05.756851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 389/768] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:05 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:05.827428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-860909f8-559e-481c-9c27-0fb90833cb65 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 204 len: 0 microversion: 2.1 time: 0.148419 Nov 11 01:07:05.827934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 380/769] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:07:05 2021] DELETE /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:07:05.838599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:05.840511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:05.849663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.850135 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.850918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.851740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.947986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:05.949870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:05.956292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.956734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.957528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:05.957954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:05.994482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6bfb1c6d-024c-4bc9-b815-8ce1d09fbbd9 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050666 Nov 11 01:07:05.995957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 381/770] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:07:05 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 01:07:06.002624 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:06.010554 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cade72da-59ac-48d4-99f8-714d4a3dd8f3 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1514 microversion: 2.1 time: 0.176987 Nov 11 01:07:06.012394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 390/771] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:05 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:06.687595 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:06.688196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 7cf1d23b-4934-4920-b304-0958f87dd3c5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:06.693949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:06.694517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:06.695523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:06.695888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:06.710679 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] HTTP exception thrown: Instance 7cf1d23b-4934-4920-b304-0958f87dd3c5 could not be found. Nov 11 01:07:06.711321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Returning 404 to user: Instance 7cf1d23b-4934-4920-b304-0958f87dd3c5 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:07:06.712415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8ca57927-f836-4a51-aec1-9a5dc96eecdb tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5" status: 404 len: 111 microversion: 2.1 time: 0.031173 Nov 11 01:07:06.712941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 382/772] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:06 2021] GET /compute/v2.1/servers/7cf1d23b-4934-4920-b304-0958f87dd3c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:07:06.773473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:06.774109 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:06.781116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:06.781580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:06.782348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:06.782774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:06.932617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:06.940523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f2c3f8a7-e1d0-46a4-b04d-42d227ac9568 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.170763 Nov 11 01:07:06.941033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 391/773] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:06 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:07.029139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:07.029741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:07.036442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:07.036886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:07.037732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:07.038181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:07.166181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:07.173428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8a839283-7511-42c5-86e4-c3bd69dc6aa6 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1514 microversion: 2.1 time: 0.148592 Nov 11 01:07:07.173977 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 383/774] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:07 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:07.957535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:07.958144 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:07.965949 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:07.966413 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:07.967235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:07.967676 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:08.096838 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:08.104504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9f158f5e-325c-42cf-bf0f-6a3e0b70324f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.150846 Nov 11 01:07:08.105806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 392/775] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:07 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:08.189899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:08.190436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:08.196752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:08.197203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:08.198000 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:08.198477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:08.327382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:08.335272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9ae25201-a647-4b00-b771-aad82c135b4f tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1514 microversion: 2.1 time: 0.149009 Nov 11 01:07:08.335830 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 384/776] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:08 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:08.668753 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:07:08.668998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: Thu Nov 11 01:07:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:07:09.122423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:09.123047 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:09.129241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:09.129687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:09.130452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:09.130876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:09.262173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:09.269830 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c900b228-c2ce-4861-b11a-ffd41e1e5d6a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.151740 Nov 11 01:07:09.270396 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 393/777] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:09 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:09.352662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:09.353271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:09.359703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:09.360158 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:09.360988 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:09.361440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:09.493746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:09.501437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2513d6f3-24b9-485b-b962-8c6a96287b7a tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1514 microversion: 2.1 time: 0.152416 Nov 11 01:07:09.501991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 385/778] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:09 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:10.287554 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:10.288293 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:10.295104 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:10.295555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:10.296328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:10.296761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:10.423490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:10.431227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ffb70527-76c1-4e1d-85d1-abc233e8f8ff tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.147303 Nov 11 01:07:10.431803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 394/779] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:10 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:10.517521 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:10.518132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:10.524257 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:10.524708 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:10.525482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:10.525915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:10.658713 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:10.665981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f388402f-de80-41d6-918b-e75235aff3fa tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1514 microversion: 2.1 time: 0.152094 Nov 11 01:07:10.666537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 386/780] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:10 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:11.448697 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:11.449539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:11.456557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.457290 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.458100 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.458543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.476013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:11.476621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:11.483156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.483735 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.484603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.485130 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.510919 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:07:11.586491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a80c4999-c0b6-45cf-a132-1fdce5a0f4b7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 204 len: 0 microversion: 2.1 time: 0.113792 Nov 11 01:07:11.587317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 387/781] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:07:11 2021] DELETE /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:07:11.600426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:11.601448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:11.610584 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.611241 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.612185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.613115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.701188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:11.709777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e7ad78ab-583c-4219-b696-000858612927 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.264972 Nov 11 01:07:11.710564 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 395/782] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:11 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:11.716275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:11.717078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:11.723035 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.723489 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.724276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.724714 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.905469 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:11.918197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fb86bf8e-0468-48fd-b699-d5e41aefc277 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.322600 Nov 11 01:07:11.918197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 388/783] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:11 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:11.953500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-622b0a4a-4809-47ba-a64e-aad6e1c735cd req-0e12f319-79e1-425e-a9b6-63b0a143197e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61a1f6b-3738-404f-a57c-38c3e25aca4d", "name": "network-vif-deleted", "tag": "05b60e97-4d8c-4758-b07d-22fad0adb972"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:11.955547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:11.955547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:07:11.965344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-622b0a4a-4809-47ba-a64e-aad6e1c735cd req-0e12f319-79e1-425e-a9b6-63b0a143197e service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:11.965898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-622b0a4a-4809-47ba-a64e-aad6e1c735cd req-0e12f319-79e1-425e-a9b6-63b0a143197e service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:11.981973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-622b0a4a-4809-47ba-a64e-aad6e1c735cd req-0e12f319-79e1-425e-a9b6-63b0a143197e service nova] Creating event network-vif-deleted:05b60e97-4d8c-4758-b07d-22fad0adb972 for instance a61a1f6b-3738-404f-a57c-38c3e25aca4d on hv-cinder-81708 Nov 11 01:07:11.984158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:11.989034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-622b0a4a-4809-47ba-a64e-aad6e1c735cd req-0e12f319-79e1-425e-a9b6-63b0a143197e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039570 Nov 11 01:07:11.990124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 389/784] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:07:11.995109 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-38793640-249f-4adc-9f10-67f6310d9a6b tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1514 microversion: 2.1 time: 0.283176 Nov 11 01:07:11.995769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 396/785] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:11 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:12.728678 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:12.729374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:12.737314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:12.737756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:12.738540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:12.738996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:12.869818 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:12.877451 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b2cd07e6-aa7f-4c71-bb9d-6625abb28cf5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.153328 Nov 11 01:07:12.878010 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 390/786] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:12 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:12.932406 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:12.933037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:12.939434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:12.939879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:12.940659 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:12.941093 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:13.012502 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:13.013108 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:13.018776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:13.019388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:13.020156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:13.020582 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:13.051931 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:13.052375 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:13.053426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'fault' on Instance uuid a61a1f6b-3738-404f-a57c-38c3e25aca4d {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:13.081583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:13.088847 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5e9cd3ee-041d-4f43-b012-3d5a0373d2fe tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.160102 Nov 11 01:07:13.090061 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 397/787] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:12 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:13.100161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:13.107606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-147ee3bd-9b5d-4c83-a591-dc6b28d27c76 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1308 microversion: 2.1 time: 0.099303 Nov 11 01:07:13.108160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 391/788] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:13 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:13.893867 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:13.894481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:13.900542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:13.900996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:13.901810 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:13.902246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:14.030190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:14.037975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d81f5eef-c68f-4aec-a217-be3dd934b5a2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.147732 Nov 11 01:07:14.038533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 398/789] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:13 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:14.106563 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:14.107195 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:14.113274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:14.113713 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:14.114473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:14.114899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:14.124015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:14.124628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:14.130940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:14.131416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:14.132183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:14.132608 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:14.163843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:14.164197 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:14.164634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lazy-loading 'fault' on Instance uuid a61a1f6b-3738-404f-a57c-38c3e25aca4d {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:14.208895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325e6f2cc9e0420a8f09d879000375d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ffc4ef7782463480e07227c26cfa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:14.216548 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-efb4dd04-03d0-457e-af8c-301a6444ada8 tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 200 len: 1308 microversion: 2.1 time: 0.095986 Nov 11 01:07:14.217130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 399/790] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:14 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:14.274275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:14.282070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8eff088f-1d0a-4203-a6a8-361f1d85f2c2 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.179724 Nov 11 01:07:14.282633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 392/791] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:14 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:15.055604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:15.056227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:15.063057 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:15.063505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:15.064289 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:15.064725 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:15.194545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:15.203842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-62a92570-a0b3-4e3a-b0c9-4823d1082c92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.151886 Nov 11 01:07:15.204624 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 400/792] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:15 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:15.235615 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:15.236172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] [instance: a61a1f6b-3738-404f-a57c-38c3e25aca4d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:15.243003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:15.243640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:15.244576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:15.245183 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:15.259256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] HTTP exception thrown: Instance a61a1f6b-3738-404f-a57c-38c3e25aca4d could not be found. Nov 11 01:07:15.260082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] Returning 404 to user: Instance a61a1f6b-3738-404f-a57c-38c3e25aca4d could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:07:15.261063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-85f37488-ec4b-48c0-90fc-8318fd224edf tempest-AttachVolumeNegativeTest-593419858 tempest-AttachVolumeNegativeTest-593419858-project] 10.222.0.52 "GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d" status: 404 len: 111 microversion: 2.1 time: 0.029166 Nov 11 01:07:15.262178 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 393/793] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:15 2021] GET /compute/v2.1/servers/a61a1f6b-3738-404f-a57c-38c3e25aca4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:07:15.299323 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:15.300352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:15.306935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:15.307411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:15.308842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:15.309284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:15.452730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:15.460716 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ab421be6-5ede-4e08-98c3-8394a702a4e7 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.164957 Nov 11 01:07:15.461307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 401/794] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:15 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:16.221049 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:16.221654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:16.227403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:16.227853 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:16.228622 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:16.229064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:16.376796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:16.384722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-82fe05e5-f06d-46f6-8c78-449f9bb77319 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.167340 Nov 11 01:07:16.385278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 394/795] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:16 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:16.477564 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:16.478174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:16.495126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:16.495126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:16.495126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:16.495126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:16.586914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-471769049", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "a2a7ef17-53bb-4307-9d1e-6ba2e00cf3fa"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:16.627530 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:16.636461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1317eba5-b2e2-498d-a183-1981b2c33b51 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.162208 Nov 11 01:07:16.645490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 402/796] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:16 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:16.646894 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] validate_networks() for [('a2a7ef17-53bb-4307-9d1e-6ba2e00cf3fa', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:07:17.006230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:07:17.006657 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:07:17.007302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:07:17.007748 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:07:17.008284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:07:17.017156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:17.017606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:17.018416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:17.018854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:17.038366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Getting quotas for project 53f9822d826e47279ba9ce7297752c6e. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:07:17.042977 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Getting quotas for user 11909fcae757416d88e258fb42f1859d and project 53f9822d826e47279ba9ce7297752c6e. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:07:17.054039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:07:17.056349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:07:17.101507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6f67a441-0686-469c-8dd4-9e8f467e1ae7 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518357 Nov 11 01:07:17.107603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 395/797] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:07:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:07:17.112522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b83ef584-1365-4458-83e0-a7114d1fff1f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:17.113133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b83ef584-1365-4458-83e0-a7114d1fff1f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:17.167059 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b83ef584-1365-4458-83e0-a7114d1fff1f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:17.173379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b83ef584-1365-4458-83e0-a7114d1fff1f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1218 microversion: 2.1 time: 0.064517 Nov 11 01:07:17.174115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 403/798] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:17 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:17.404061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:17.405474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:17.412710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:17.413627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:17.415528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:17.416208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:17.569545 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:17.581178 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d35853d1-6365-4337-bc85-6b9078368adf tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.181933 Nov 11 01:07:17.592370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 396/799] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:17 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:17.654547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:17.655955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:17.661588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:17.662118 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:17.663053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:17.663582 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:17.829565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:17.850831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d5395ecd-c77c-443a-bcf3-70dbd769d797 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.191875 Nov 11 01:07:17.854384 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 404/800] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:17 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:18.189406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:18.189924 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:18.195751 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:18.196194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:18.197288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:18.197715 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:18.255940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:18.268741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-580e37af-e3be-4c7f-99ce-ceaf44e1c7da tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1270 microversion: 2.1 time: 0.083086 Nov 11 01:07:18.269297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 397/801] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:18 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:18.598930 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:18.599541 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:18.605824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:18.606277 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:18.607079 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:18.607525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:18.798246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:18.806392 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4170332c-bf9b-4fad-95bb-8a9ad0390a49 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.211185 Nov 11 01:07:18.806982 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 405/802] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:18 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:18.873533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:18.874300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:18.883547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:18.883547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:18.883547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:18.883547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:19.128638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:19.135899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a0298233-a240-446f-9cfa-85c395fc43f1 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1509 microversion: 2.1 time: 0.267772 Nov 11 01:07:19.145998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 398/803] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:18 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:19.286130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:19.286745 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:19.292914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:19.293348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:19.294410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:19.294852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:19.358295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:19.368516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-579a0c44-2ec1-4f20-9aef-1e5493af833c tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1276 microversion: 2.1 time: 0.086006 Nov 11 01:07:19.369301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 406/804] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:19 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:19.824383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:19.825009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:19.831074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:19.831529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:19.832513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:19.832949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:19.945891 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-e1f104b0-97b3-4bde-a223-77768ebea867 req-c5d4e95a-66af-45fe-a467-2d5bc5e11743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60ae7a9-6eb4-4a87-88ca-6c291f834861", "name": "network-vif-deleted", "tag": "5cfe983d-38d0-4d2b-870d-35adc82de8f4"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:19.947801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:19.947801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:07:19.964889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-e1f104b0-97b3-4bde-a223-77768ebea867 req-c5d4e95a-66af-45fe-a467-2d5bc5e11743 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:19.965342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-e1f104b0-97b3-4bde-a223-77768ebea867 req-c5d4e95a-66af-45fe-a467-2d5bc5e11743 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:19.985128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-e1f104b0-97b3-4bde-a223-77768ebea867 req-c5d4e95a-66af-45fe-a467-2d5bc5e11743 service nova] Creating event network-vif-deleted:5cfe983d-38d0-4d2b-870d-35adc82de8f4 for instance f60ae7a9-6eb4-4a87-88ca-6c291f834861 on hv-cinder-81708 Nov 11 01:07:19.990768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-e1f104b0-97b3-4bde-a223-77768ebea867 req-c5d4e95a-66af-45fe-a467-2d5bc5e11743 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048487 Nov 11 01:07:19.991528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 407/805] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:07:20.088511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:20.098734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-33814862-490b-49da-a29e-0c5bfee59bb5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.278124 Nov 11 01:07:20.099671 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 399/806] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:19 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:20.154499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:20.155235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:20.170448 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:20.170889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:20.171751 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:20.172262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:20.204750 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:20.205211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:20.210223 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-bd5cc256-d746-4d04-b25a-3e80fa2dac96 req-25b23f03-4ac3-4dc2-a490-536c2355f443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a1527b-96a7-4813-83a3-56ade785f0d6", "tag": "fa02e664-8dbd-49a5-9737-f85d20033a56"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:20.211791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:20.211791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:07:20.212479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lazy-loading 'fault' on Instance uuid f60ae7a9-6eb4-4a87-88ca-6c291f834861 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:20.220730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-bd5cc256-d746-4d04-b25a-3e80fa2dac96 req-25b23f03-4ac3-4dc2-a490-536c2355f443 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:20.221428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-bd5cc256-d746-4d04-b25a-3e80fa2dac96 req-25b23f03-4ac3-4dc2-a490-536c2355f443 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:20.234542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-bd5cc256-d746-4d04-b25a-3e80fa2dac96 req-25b23f03-4ac3-4dc2-a490-536c2355f443 service nova] Creating event network-changed:fa02e664-8dbd-49a5-9737-f85d20033a56 for instance 14a1527b-96a7-4813-83a3-56ade785f0d6 on hv-cinder-81708 Nov 11 01:07:20.239465 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-bd5cc256-d746-4d04-b25a-3e80fa2dac96 req-25b23f03-4ac3-4dc2-a490-536c2355f443 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Nov 11 01:07:20.240266 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 400/807] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:07:20.268490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:20.277060 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7d867408-4d3f-454d-9338-cbb15edc9162 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 200 len: 1312 microversion: 2.1 time: 0.126832 Nov 11 01:07:20.278365 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 408/808] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:20 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:20.385928 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:20.387380 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:20.393303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:20.393749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:20.394661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:20.395040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:20.867294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:20.875695 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5b9be9c7-98b7-42c8-8819-f8e93c2ed545 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.493685 Nov 11 01:07:20.876721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 401/809] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:20 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:21.116770 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:21.117376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:21.123908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.124359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.125131 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.125626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.252274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:21.259907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-43adb8c7-eb6e-4d25-a5af-487357397061 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.146831 Nov 11 01:07:21.260474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 409/810] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:21 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:21.295467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:21.296067 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: f60ae7a9-6eb4-4a87-88ca-6c291f834861] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:21.302149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.302615 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.303413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.303943 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.316803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] HTTP exception thrown: Instance f60ae7a9-6eb4-4a87-88ca-6c291f834861 could not be found. Nov 11 01:07:21.317370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Returning 404 to user: Instance f60ae7a9-6eb4-4a87-88ca-6c291f834861 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:07:21.318165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-69561f37-901b-4cf5-8281-875b96d2d309 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861" status: 404 len: 111 microversion: 2.1 time: 0.027297 Nov 11 01:07:21.318699 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 402/811] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:21 2021] GET /compute/v2.1/servers/f60ae7a9-6eb4-4a87-88ca-6c291f834861 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:07:21.326788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:21.327307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:21.333005 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.333452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.334219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.334649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.360156 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:07:21.432501 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b4345ad6-57bf-420e-80b9-88185743c468 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 204 len: 0 microversion: 2.1 time: 0.109329 Nov 11 01:07:21.433092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 410/812] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:07:21 2021] DELETE /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:07:21.440978 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:21.441576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:21.447297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.447741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.449150 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.449587 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.581173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:21.588312 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cd1bcc66-35e1-40c4-b60e-7f739edbc473 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.150978 Nov 11 01:07:21.588882 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 403/813] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:21 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:21.893319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:21.894062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:21.900231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.900673 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:21.901668 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:21.902139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:22.084909 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:22.092566 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9b9d12e7-2a09-4107-b7bd-814b3ca8dece tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.203377 Nov 11 01:07:22.093139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 411/814] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:21 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:22.277304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:22.277858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:22.283640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:22.284082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:22.284844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:22.285272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:22.414778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:22.423224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e328c4b5-3bca-4141-8710-8d6f444da61a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.150090 Nov 11 01:07:22.423783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 404/815] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:22 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:22.606681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:22.607342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:22.613602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:22.614048 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:22.614821 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:22.615284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:22.742050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:22.749624 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-abd761ae-b4b5-4679-943d-e54bdaa1ea57 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.147534 Nov 11 01:07:22.750186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 412/816] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:22 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:23.109804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:23.110405 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:23.116186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:23.116627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:23.117390 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:23.117816 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:23.248901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:23.255997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c4bba1c7-dcbc-4226-9a4b-6cc4f48cea0a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.149856 Nov 11 01:07:23.256558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 405/817] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:23 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:23.439892 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:23.440602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:23.446657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:23.447161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:23.447955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:23.449160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:23.578539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:23.586308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-07ef26ed-d6f5-4c2b-b366-ff4525892746 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.150036 Nov 11 01:07:23.586870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 413/818] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:23 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:23.766804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:23.767440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:23.773594 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:23.774035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:23.774803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:23.775275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:23.905376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:23.912690 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1695c9be-4f93-4216-81f4-2c2d7d6770ac tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.149588 Nov 11 01:07:23.913253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 406/819] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:23 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:24.273011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:24.273701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:24.280796 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:24.281248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:24.282063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:24.282476 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:24.413522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:24.420760 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5b578992-95eb-4aa7-8632-25f47781a69e tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.151481 Nov 11 01:07:24.421341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 414/820] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:24 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:24.603208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:24.603834 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:24.610000 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:24.610443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:24.611248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:24.611673 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:24.835801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:24.844556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3a1892f1-880b-4d66-8f12-e3202960f24b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.244912 Nov 11 01:07:24.845374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 407/821] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:24 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:24.930192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:24.930858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:24.937627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:24.938085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:24.938872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:24.939490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:25.091467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:25.098906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d9e64124-fe38-4c28-9cc8-ca21c0076b28 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.172738 Nov 11 01:07:25.099510 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 415/822] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:24 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:25.437772 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:25.438290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:25.444155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:25.444603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:25.445369 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:25.445802 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:25.573166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:25.581051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f2ff013d-1427-4056-98c0-fc4769981e01 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.147005 Nov 11 01:07:25.581608 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 408/823] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:25 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:25.861805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:25.862439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:25.868898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:25.869324 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:25.870111 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:25.871217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:26.003656 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:26.011685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0972bd59-388e-4c1c-951b-9273db3fe447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.153186 Nov 11 01:07:26.012252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 416/824] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:25 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:26.116424 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:26.116980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:26.123958 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:26.124405 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:26.125170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:26.125601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:26.253691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:26.261934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-62e95015-3cc3-480e-80da-e764728f2435 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.148481 Nov 11 01:07:26.262598 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 409/825] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:26 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:26.597269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:26.597906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:26.603624 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:26.604065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:26.604940 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:26.605532 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:26.750695 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:26.758054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3f9e45c2-a94b-40e1-85fd-302e51083070 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.164419 Nov 11 01:07:26.758989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 417/826] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:26 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:27.028405 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:27.029042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:27.035092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:27.035560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:27.036387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:27.036892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:27.170571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:27.178345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ba6f15ba-4799-42c7-a925-bf3dd3dded74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.153687 Nov 11 01:07:27.178903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 410/827] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:27 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:27.278075 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:27.278591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:27.286161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:27.286611 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:27.287439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:27.287873 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:27.418275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:27.425717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b1217b0e-1985-465d-b736-690f128d3438 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.151373 Nov 11 01:07:27.426323 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 418/828] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:27 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:27.774672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:27.775300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:27.781762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:27.782216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:27.783062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:27.783497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:27.923200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:27.930494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-34c52aa3-1f90-46a0-89f7-584869a1e299 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.159417 Nov 11 01:07:27.931154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 411/829] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:27 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:28.196326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:28.196846 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:28.203449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.203892 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:28.204658 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.205088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:28.332182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:28.340860 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c63b5bce-92bf-4ef3-b087-07178e131428 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.148292 Nov 11 01:07:28.341418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 419/830] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:28 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:28.443487 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:28.444121 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:28.451185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.451570 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:28.452340 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.452762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:28.584383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:28.591967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0adae1e9-a467-427e-a7b2-793592b34420 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.152500 Nov 11 01:07:28.592531 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 412/831] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:28 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:28.746543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-97991e56-722e-47fa-a9a7-47fb3b1cf5a6 req-0850c67b-702e-4ea3-a39a-df0879a55a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a1527b-96a7-4813-83a3-56ade785f0d6", "name": "network-vif-plugged", "status": "completed", "tag": "fa02e664-8dbd-49a5-9737-f85d20033a56"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:28.748227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:28.748227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:07:28.755551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-97991e56-722e-47fa-a9a7-47fb3b1cf5a6 req-0850c67b-702e-4ea3-a39a-df0879a55a92 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.756050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-97991e56-722e-47fa-a9a7-47fb3b1cf5a6 req-0850c67b-702e-4ea3-a39a-df0879a55a92 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:28.768055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-97991e56-722e-47fa-a9a7-47fb3b1cf5a6 req-0850c67b-702e-4ea3-a39a-df0879a55a92 service nova] Creating event network-vif-plugged:fa02e664-8dbd-49a5-9737-f85d20033a56 for instance 14a1527b-96a7-4813-83a3-56ade785f0d6 on hv-cinder-81708 Nov 11 01:07:28.772888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-97991e56-722e-47fa-a9a7-47fb3b1cf5a6 req-0850c67b-702e-4ea3-a39a-df0879a55a92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030786 Nov 11 01:07:28.773634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 420/832] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:07:28.946588 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:28.947223 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:28.953292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.953729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:28.954559 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:28.955007 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:29.149831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:29.157530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-09f677a0-60de-42cb-ba91-b908e426e3b3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.214497 Nov 11 01:07:29.158091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 413/833] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:28 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:29.359043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:29.359742 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:29.365554 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:29.366004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:29.366787 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:29.367244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:29.505130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:29.514305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d75476f0-8f88-49a5-84df-6d4067f15775 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.160404 Nov 11 01:07:29.514879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 421/834] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:29 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:29.608839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:29.609376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:29.615607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:29.616249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:29.617039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:29.617473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:29.747196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:29.754490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4c821e50-51ca-497e-8e0c-d4d1236864a3 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.149609 Nov 11 01:07:29.755228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 414/835] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:29 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:30.173312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:30.174015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:30.180417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:30.180865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:30.181635 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:30.182234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:30.320654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:30.329497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-542f2d31-86a0-4b88-9ea6-3fd3fa376aff tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1318 microversion: 2.1 time: 0.159688 Nov 11 01:07:30.335199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 422/836] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:30 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:30.530747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:30.531373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:30.537286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:30.537736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:30.538509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:30.538954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:30.666888 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:30.675341 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2777b8ed-6a50-496b-86a0-8d6e2f83f0a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.148373 Nov 11 01:07:30.675909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 415/837] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:30 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:30.771594 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:30.772192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:30.779275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:30.779720 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:30.780486 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:30.780960 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:30.909794 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:30.917274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d1965a25-08c7-4c34-9b98-65c2cf78aa1a tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.149306 Nov 11 01:07:30.917918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 423/838] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:30 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:31.349092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:31.349722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:31.356536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.356988 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.358100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.358199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.495507 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:31.503379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b2914f8c-1c45-4ea1-aaa5-faa2fd2e9a4f tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1508 microversion: 2.1 time: 0.157901 Nov 11 01:07:31.503944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 416/839] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:31 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:31.521149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "429196ba-8f15-492f-a72e-30f3d8451061", "device": "/dev/sdb"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:31.522318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:31.528997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.529452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.530366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.530808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.697955 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:31.700259 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:31.721453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.722108 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.723128 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.723648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.841313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c34d9fec-063b-4ecb-8d25-901d47dd140a tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "POST /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323894 Nov 11 01:07:31.842257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 424/840] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:07:31 2021] POST /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:07:31.874178 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:31.882299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ccb0d4da-ab1d-4aa8-b6ad-80f6801fc1bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1723 microversion: 2.1 time: 0.191551 Nov 11 01:07:31.882876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 417/841] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:31 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:31.936450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:31.937163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:31.943687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.944155 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:31.944923 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:31.945352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:32.097257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:32.103288 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f2fd53ea-10ff-4e23-9f8a-526d7000eca8 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.171760 Nov 11 01:07:32.103882 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 425/842] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:31 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:32.899421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:32.900323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:32.907856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:32.908301 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:32.909166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:32.909534 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:33.068245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:33.077191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-aff36f21-d215-4e4e-9f5c-1f959e90dc02 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1700 microversion: 2.1 time: 0.181293 Nov 11 01:07:33.089070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 418/843] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:32 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1700 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:33.093830 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1dfb43de-6775-4f0f-8b1e-80df35602fc5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:33.100841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1dfb43de-6775-4f0f-8b1e-80df35602fc5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:33.101502 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1dfb43de-6775-4f0f-8b1e-80df35602fc5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:33.122819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:33.123464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:33.126464 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1dfb43de-6775-4f0f-8b1e-80df35602fc5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Going to try to start instance {{(pid=116015) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 11 01:07:33.129396 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:33.129842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:33.130573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:33.131092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:33.171423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1dfb43de-6775-4f0f-8b1e-80df35602fc5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.081696 Nov 11 01:07:33.172364 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 426/844] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:07:33 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:07:33.180677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:33.181308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:33.188895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:33.191436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:33.192282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:33.193462 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:33.312232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:33.320790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e2558845-67e7-45ff-8734-dcbdabccc010 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.202972 Nov 11 01:07:33.321462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 419/845] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:33 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:33.378733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:33.387039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2321c80d-fe87-4280-ace9-45b9983f376b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1709 microversion: 2.1 time: 0.209725 Nov 11 01:07:33.387643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 427/846] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:33 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1709 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:34.337216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:34.337891 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:34.344232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:34.344662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:34.345425 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:34.345851 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:34.405092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:34.405704 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:34.412084 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:34.412573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:34.413633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:34.414136 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:34.664849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:34.672739 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-49625324-6af9-464e-af93-776af12f07c4 tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1521 microversion: 2.1 time: 0.339031 Nov 11 01:07:34.673309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 420/847] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:34 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:34.731542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:34.739189 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9082b132-6b1c-48a4-95b6-be28b47e7140 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1709 microversion: 2.1 time: 0.338217 Nov 11 01:07:34.739761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 428/848] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:34 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1709 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:35.365166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-34094d5c-771e-46f3-aead-845fa541aebf req-f36f8e30-2f46-4a58-9598-03d392b7aaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45620e84-de01-477d-a818-263dae68f119", "name": "network-vif-deleted", "tag": "82da993e-a127-427f-9c31-a8b1a4846d8f"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:07:35.367453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:07:35.367453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:07:35.378101 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-34094d5c-771e-46f3-aead-845fa541aebf req-f36f8e30-2f46-4a58-9598-03d392b7aaee service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:35.379112 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-34094d5c-771e-46f3-aead-845fa541aebf req-f36f8e30-2f46-4a58-9598-03d392b7aaee service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:35.392970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-34094d5c-771e-46f3-aead-845fa541aebf req-f36f8e30-2f46-4a58-9598-03d392b7aaee service nova] Creating event network-vif-deleted:82da993e-a127-427f-9c31-a8b1a4846d8f for instance 45620e84-de01-477d-a818-263dae68f119 on hv-cinder-81708 Nov 11 01:07:35.398132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-34094d5c-771e-46f3-aead-845fa541aebf req-f36f8e30-2f46-4a58-9598-03d392b7aaee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036776 Nov 11 01:07:35.398741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 421/849] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:07:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:07:35.689663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:35.690265 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:35.696481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:35.696961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:35.697860 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:35.698296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:35.727934 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:35.728375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:35.728818 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lazy-loading 'fault' on Instance uuid 45620e84-de01-477d-a818-263dae68f119 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:07:35.757119 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:35.757845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:35.764044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:35.764496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:35.765394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:35.765829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:35.772442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6a452de8074d36a36c14c6e46cb3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9ddce0b6794348af30770172bcd5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:35.779851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-507375b5-aead-4bf2-9ba5-b9e710252e6d tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 200 len: 1311 microversion: 2.1 time: 0.093783 Nov 11 01:07:35.780421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 429/850] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:35 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:07:35.894777 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:07:35.902896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8f929eb6-3b56-40b8-ba05-1db897f7009f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1713 microversion: 2.1 time: 0.149285 Nov 11 01:07:35.904184 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 422/851] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:35 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:07:36.796385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:07:36.796997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] [instance: 45620e84-de01-477d-a818-263dae68f119] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:07:36.803225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:36.803675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:36.804451 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:07:36.804885 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:07:36.818713 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] HTTP exception thrown: Instance 45620e84-de01-477d-a818-263dae68f119 could not be found. Nov 11 01:07:36.819316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] Returning 404 to user: Instance 45620e84-de01-477d-a818-263dae68f119 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:07:36.820116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0124268c-ad2d-44cc-9bcf-c2658369e22c tempest-ServerRescueNegativeTestJSON-173684188 tempest-ServerRescueNegativeTestJSON-173684188-project] 10.222.0.52 "GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119" status: 404 len: 111 microversion: 2.1 time: 0.027400 Nov 11 01:07:36.820634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 430/852] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:07:36 2021] GET /compute/v2.1/servers/45620e84-de01-477d-a818-263dae68f119 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:07:46.164153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:07:46.164756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:07:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:08:00.389145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:00.389752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:00.395954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:00.396581 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:00.397515 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:00.398265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:00.478307 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'services' on Instance uuid 14a1527b-96a7-4813-83a3-56ade785f0d6 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:00.547199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9bbc5b96-9b15-4d30-a18b-60199e339bbe tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6/os-volume_attachments/429196ba-8f15-492f-a72e-30f3d8451061" status: 202 len: 0 microversion: 2.1 time: 0.162114 Nov 11 01:08:00.547825 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 423/853] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:08:00 2021] DELETE /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6/os-volume_attachments/429196ba-8f15-492f-a72e-30f3d8451061 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:08:02.735439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:02.736017 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:02.743287 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:02.743997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:02.745027 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:02.745604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:02.771901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:08:02.851614 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1c3bde36-51c0-4b40-9183-ff33553bffef tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 204 len: 0 microversion: 2.1 time: 0.119514 Nov 11 01:08:02.852232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 431/854] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:08:02 2021] DELETE /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:08:02.862168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:02.862870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:02.877737 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:02.878182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:02.878990 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:02.879613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:03.020285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:03.027645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9f6d2a3f-823e-44fc-9ab9-ea84505029ae tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1514 microversion: 2.1 time: 0.170279 Nov 11 01:08:03.028221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 424/855] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:02 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:04.045209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:04.045933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:04.052199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:04.052651 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:04.053434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:04.053879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:04.196074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:04.203881 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-58032d74-fd38-42b2-9136-1dbd7c408fb8 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1514 microversion: 2.1 time: 0.162594 Nov 11 01:08:04.204534 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 432/856] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:04 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:05.221773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:05.222387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:05.228907 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:05.229352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:05.230151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:05.230586 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:05.421264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:05.428963 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5d5eb8d7-0590-44e7-835e-74df1e7329c3 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1514 microversion: 2.1 time: 0.210770 Nov 11 01:08:05.429556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 425/857] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:05 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:08:06.448476 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:06.449086 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:06.456864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:06.457308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:06.458088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:06.458516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:06.601998 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:06.609604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9d24dd8f-3144-4908-a2c8-8c621c5d54b6 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1514 microversion: 2.1 time: 0.165265 Nov 11 01:08:06.610183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 433/858] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:06 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:08:07.625854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:07.626459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:07.632768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:07.633212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:07.633976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:07.634405 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:07.769528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:07.777980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8da9930d-90b9-4bdf-8c5e-56d5cb48a8e1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1514 microversion: 2.1 time: 0.156339 Nov 11 01:08:07.779221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 426/859] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:07 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:08.796732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:08.797385 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:08.803624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:08.804305 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:08.805251 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:08.805887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:08.821905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-40c734dd-5578-4155-8f40-ca79d5951a3e req-c27a9bf9-7a5c-4e1a-b9a2-1043e8faa7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a1527b-96a7-4813-83a3-56ade785f0d6", "name": "network-vif-deleted", "tag": "fa02e664-8dbd-49a5-9737-f85d20033a56"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:08:08.824215 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:08:08.824215 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:08:08.831333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-40c734dd-5578-4155-8f40-ca79d5951a3e req-c27a9bf9-7a5c-4e1a-b9a2-1043e8faa7ed service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:08.831828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-40c734dd-5578-4155-8f40-ca79d5951a3e req-c27a9bf9-7a5c-4e1a-b9a2-1043e8faa7ed service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:08.839687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:08.841382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:08.842061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'fault' on Instance uuid 14a1527b-96a7-4813-83a3-56ade785f0d6 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:08.844104 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-40c734dd-5578-4155-8f40-ca79d5951a3e req-c27a9bf9-7a5c-4e1a-b9a2-1043e8faa7ed service nova] Creating event network-vif-deleted:fa02e664-8dbd-49a5-9737-f85d20033a56 for instance 14a1527b-96a7-4813-83a3-56ade785f0d6 on hv-cinder-81708 Nov 11 01:08:08.849868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-40c734dd-5578-4155-8f40-ca79d5951a3e req-c27a9bf9-7a5c-4e1a-b9a2-1043e8faa7ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185374 Nov 11 01:08:08.850473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 434/860] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:08:08.891409 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:08.899516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e2671bb3-dc13-4e73-afff-461b0b65a583 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1308 microversion: 2.1 time: 0.106854 Nov 11 01:08:08.907100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 427/861] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:08 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:08:09.917497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:09.918298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:09.927307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:09.927839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:09.928699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:09.929455 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:09.965865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:09.966219 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:09.966670 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'fault' on Instance uuid 14a1527b-96a7-4813-83a3-56ade785f0d6 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:10.013022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:10.019885 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-62bc627d-5ed5-4861-b8da-971bac159d27 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1308 microversion: 2.1 time: 0.106788 Nov 11 01:08:10.020442 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 435/862] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:09 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:11.036363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:11.036987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:11.043142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:11.043597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:11.044381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:11.044822 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:11.076219 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:11.076676 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:11.077155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'fault' on Instance uuid 14a1527b-96a7-4813-83a3-56ade785f0d6 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:11.116645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:11.124437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2860a053-007c-4e8f-81a9-2521c2d12ee1 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1308 microversion: 2.1 time: 0.091880 Nov 11 01:08:11.124997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 428/863] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:11 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:12.141145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:12.141831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:12.148090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:12.148531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:12.149305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:12.149727 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:12.180248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:12.180695 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:12.181146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lazy-loading 'fault' on Instance uuid 14a1527b-96a7-4813-83a3-56ade785f0d6 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:12.220964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11909fcae757416d88e258fb42f1859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9822d826e47279ba9ce7297752c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:12.228045 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7d21055d-628c-49e2-b6ca-4853165ad237 tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 200 len: 1308 microversion: 2.1 time: 0.091146 Nov 11 01:08:12.228604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 436/864] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:12 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:13.244372 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:13.244984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] [instance: 14a1527b-96a7-4813-83a3-56ade785f0d6] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:13.252028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:13.252476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:13.253250 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:13.253680 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:13.266966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] HTTP exception thrown: Instance 14a1527b-96a7-4813-83a3-56ade785f0d6 could not be found. Nov 11 01:08:13.267547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] Returning 404 to user: Instance 14a1527b-96a7-4813-83a3-56ade785f0d6 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:08:13.268360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-74540078-d73c-4742-aaad-a42e1b567d8d tempest-VolumesSnapshotTestJSON-2033150805 tempest-VolumesSnapshotTestJSON-2033150805-project] 10.222.0.52 "GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6" status: 404 len: 111 microversion: 2.1 time: 0.027816 Nov 11 01:08:13.268887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 429/865] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:13 2021] GET /compute/v2.1/servers/14a1527b-96a7-4813-83a3-56ade785f0d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:08:33.353188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:33.353703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:33.359380 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:33.359967 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:33.360824 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:33.361254 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:33.389403 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-344740f7-0bf5-462a-9390-1ae5b6e07c28 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments/39ed9f62-2194-41b3-a92a-ecc1de3a5bb5" status: 200 len: 194 microversion: 2.20 time: 0.201178 Nov 11 01:08:33.389965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 437/866] 10.222.0.52 () {60 vars in 1453 bytes} [Thu Nov 11 01:08:33 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments/39ed9f62-2194-41b3-a92a-ecc1de3a5bb5 => generated 194 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:33.450871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:33.451466 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:33.457634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:33.458083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:33.458847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:33.459353 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:33.540971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lazy-loading 'services' on Instance uuid c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:33.611650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a74f44b1-2227-4057-b697-aa5308a099fa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments/39ed9f62-2194-41b3-a92a-ecc1de3a5bb5" status: 202 len: 0 microversion: 2.20 time: 0.165497 Nov 11 01:08:33.612239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 430/867] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Nov 11 01:08:33 2021] DELETE /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments/39ed9f62-2194-41b3-a92a-ecc1de3a5bb5 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:08:33.620434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:33.621348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:33.637205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:33.637731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:33.638754 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:33.639108 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:33.670381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-50e48b45-3009-43a8-b289-8bfdc8439120 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053608 Nov 11 01:08:33.670971 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 438/868] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:33 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:34.682187 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:34.683177 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:34.689253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:34.689700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:34.690472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:34.690910 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:34.721255 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-317692c2-01e5-4d08-b42f-aded188fe43e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Nov 11 01:08:34.721797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 431/869] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:34 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:08:35.732859 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:35.733711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:35.740755 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:35.741209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:35.741983 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:35.742418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:35.770098 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-88197afb-f497-47bf-b1c3-76956c5f189e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041188 Nov 11 01:08:35.770642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 439/870] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:35 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:36.781581 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:36.782971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:36.789403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:36.789569 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:36.790795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:36.791016 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:36.819641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-db41ae9b-11d5-43e3-9246-ae8488b0b8e2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041851 Nov 11 01:08:36.820180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 432/871] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:36 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:37.831244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:37.832147 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:37.838306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:37.838744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:37.839821 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:37.840249 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:37.869733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9b9569a7-b55c-4dfd-a053-41ccca5edb89 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042970 Nov 11 01:08:37.870285 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 440/872] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:37 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:38.881724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:38.882627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:38.888905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:38.889351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:38.890122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:38.890555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:38.918872 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-30f246bc-f432-4a13-985c-1ee88bd1124c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041009 Nov 11 01:08:38.919446 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 433/873] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:38 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:39.929673 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:39.930599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:39.936825 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:39.937263 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:39.938024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:39.938449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:39.967605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5fcbe28c-4cc4-4500-889b-f9f570aa7bad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041640 Nov 11 01:08:39.968190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 441/874] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:39 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:40.980204 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:40.981105 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:40.988491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:40.988936 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:40.989711 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:40.990139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:41.018241 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4bdf8619-84be-4152-957a-e86cfae10e1a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041780 Nov 11 01:08:41.018774 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 434/875] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:40 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:42.030002 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:42.030967 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:42.037473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:42.037925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:42.038709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:42.039238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:42.068726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-12cad9e2-d309-417f-8e36-900df58e7aae tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042771 Nov 11 01:08:42.069287 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 442/876] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:42 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:08:43.079710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:43.081023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:43.087263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:43.087718 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:43.088490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:43.088926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:43.117544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-47fd7fa6-59fa-4ef3-8215-17e001b4094e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041738 Nov 11 01:08:43.118095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 435/877] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:08:43 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:43.176306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:43.176819 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:43.183126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:43.183678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:43.184470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:43.184906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:43.209997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:08:43.281354 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5f7d94e6-b29f-4bed-ba87-3f0e67d4bdd3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 204 len: 0 microversion: 2.20 time: 0.108753 Nov 11 01:08:43.281926 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 443/878] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Nov 11 01:08:43 2021] DELETE /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 11 01:08:43.290073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:43.290784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:43.296552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:43.296998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:43.297797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:43.298228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:43.431921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:43.440356 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:43.444980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:43.451122 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7efdba49-37cb-4fa4-a78f-6b44550b897e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.164402 Nov 11 01:08:43.453103 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 436/879] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:43 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:44.473202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:44.473890 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:44.480063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:44.480505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:44.481271 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:44.481698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:44.617044 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:44.624744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:44.626167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:44.627921 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bb1447b0-d2a4-4373-a44e-e68de224d7e0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.159440 Nov 11 01:08:44.628475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 444/880] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:44 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:45.646197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:45.646803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:45.653164 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:45.653605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:45.654374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:45.654803 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:45.787349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:45.794985 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:45.796492 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:45.797883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-642956c0-0c2c-48ba-a6f8-bc57f791ea8e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.156284 Nov 11 01:08:45.798440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 437/881] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:45 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:46.817165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:46.817857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:46.824449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:46.824893 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:46.825660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:46.826178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:46.965008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:46.973060 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:46.974564 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:46.975926 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-703abe99-3508-434a-b2cc-a33e6e51dcd4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.163353 Nov 11 01:08:46.976504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 445/882] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:46 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:47.995274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:47.995904 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:48.001982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:48.002480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:48.004292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:48.005012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:48.149781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:48.157501 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:48.159810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:48.160958 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5b80e4bd-2c5c-4e75-b66a-a8e56501ef1e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.169394 Nov 11 01:08:48.161527 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 438/883] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:47 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:49.179011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:49.179730 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:49.189441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:49.190757 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:49.192278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:49.193623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:49.463685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:49.477808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:49.479900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:49.486808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-42604605-1655-4fff-95cd-3cf8e2dee068 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1724 microversion: 2.20 time: 0.311395 Nov 11 01:08:49.494988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 446/884] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:49 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:50.511566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:50.513100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:50.538384 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:50.539263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:50.540295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:50.540949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:50.640962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:50.656652 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:50.658488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:50.663206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a02a95e8-e0d7-4e61-9552-416ccdedd73c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1656 microversion: 2.20 time: 0.158660 Nov 11 01:08:50.664325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 439/885] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:50 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:50.886227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-02e68de3-1e66-4da0-8780-f8a9cf3a5a5f req-61378fe8-c9dd-4588-9981-adf34a4c3eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bc1ebf-6b32-496c-b7ff-a005abd1dec2", "name": "network-vif-deleted", "tag": "1debaf12-1dc2-4053-8874-4078beb56b38"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:08:50.887951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:08:50.887951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:08:50.901072 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-02e68de3-1e66-4da0-8780-f8a9cf3a5a5f req-61378fe8-c9dd-4588-9981-adf34a4c3eca service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:50.902368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-02e68de3-1e66-4da0-8780-f8a9cf3a5a5f req-61378fe8-c9dd-4588-9981-adf34a4c3eca service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:50.920477 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-02e68de3-1e66-4da0-8780-f8a9cf3a5a5f req-61378fe8-c9dd-4588-9981-adf34a4c3eca service nova] Creating event network-vif-deleted:1debaf12-1dc2-4053-8874-4078beb56b38 for instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 on hv-cinder-81708 Nov 11 01:08:50.928199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-02e68de3-1e66-4da0-8780-f8a9cf3a5a5f req-61378fe8-c9dd-4588-9981-adf34a4c3eca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200234 Nov 11 01:08:50.929056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 447/886] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:08:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:08:51.681678 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:51.682288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:51.689206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:51.690197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:51.691935 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:51.692370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:51.758730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:51.767203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:51.769300 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:51.770551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a92c03c9-3150-4335-a927-6fda0fe0f891 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1656 microversion: 2.20 time: 0.092653 Nov 11 01:08:51.771381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 440/887] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:51 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:52.790216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:52.790907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:52.796906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:52.797346 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:52.798110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:52.798544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:52.858426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:52.867174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:52.868693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:52.869914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-71657887-343a-484f-b4e0-ccec6b909b46 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 200 len: 1656 microversion: 2.20 time: 0.084213 Nov 11 01:08:52.870475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 448/888] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:52 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 1656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:08:53.888532 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:53.889051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:53.895732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:53.896173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:53.896938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:53.897366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:53.911167 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] HTTP exception thrown: Instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 could not be found. Nov 11 01:08:53.911742 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Returning 404 to user: Instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:08:53.912542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d5061be6-4cc3-4602-869c-fc105e971c42 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 404 len: 111 microversion: 2.20 time: 0.027837 Nov 11 01:08:53.913056 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 441/889] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:53 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 11 01:08:53.921233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-340d533e-1d47-437e-a36f-a9f47606afd7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '.version_select at 0x7fd3640b9a60>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:53.944683 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-340d533e-1d47-437e-a36f-a9f47606afd7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329287288" status: 204 len: 0 microversion: 2.20 time: 0.027139 Nov 11 01:08:53.945256 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 449/890] 10.222.0.52 () {60 vars in 1261 bytes} [Thu Nov 11 01:08:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329287288 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 11 01:08:54.377172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1551586306", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "0a5aa8d3-8b8d-40ef-b7b2-1f6fcc263384"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:08:54.433211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] validate_networks() for [('0a5aa8d3-8b8d-40ef-b7b2-1f6fcc263384', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:08:54.713206 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-036af8f6-aa13-4500-bc65-da5955745416 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'create', calling method: .version_select at 0x7fd364177310>, body: {"keypair": {"name": "tempest-keypair-976134965"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:08:54.732645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-036af8f6-aa13-4500-bc65-da5955745416 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:08:54.738264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-036af8f6-aa13-4500-bc65-da5955745416 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for user 4d1219c765c74dcc8bb8b61d4615e0c6 and project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:08:54.806632 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-036af8f6-aa13-4500-bc65-da5955745416 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:08:54.810539 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-036af8f6-aa13-4500-bc65-da5955745416 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for user 4d1219c765c74dcc8bb8b61d4615e0c6 and project e01554f5a96c46afb1983c71a9513e16. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:08:54.823916 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-036af8f6-aa13-4500-bc65-da5955745416 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.118071 Nov 11 01:08:54.824602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 450/891] 10.222.0.52 () {62 vars in 1198 bytes} [Thu Nov 11 01:08:54 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 11 01:08:54.950633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:08:54.951173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:08:54.951645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:08:54.952052 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:08:54.952463 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:08:54.968352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:54.968352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:54.968352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:54.968694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:54.985238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Getting quotas for project 42eb5f73fb374af78bba48a01fee4398. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:08:54.990139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Getting quotas for user ff4d1564049544579728cc6109d99fe6 and project 42eb5f73fb374af78bba48a01fee4398. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:08:55.001680 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:08:55.004135 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:08:55.049719 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f538ecf1-dbee-44ad-8bc7-a17afcd83027 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677166 Nov 11 01:08:55.050461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 442/892] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:08:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:08:55.061822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b83b2a20-5265-4a70-999a-a1cf757a3f14 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:55.063273 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b83b2a20-5265-4a70-999a-a1cf757a3f14 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:55.121974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b83b2a20-5265-4a70-999a-a1cf757a3f14 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:55.130433 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b83b2a20-5265-4a70-999a-a1cf757a3f14 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1214 microversion: 2.1 time: 0.072727 Nov 11 01:08:55.131121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 451/893] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:55 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:56.114904 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-996058017", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7db40340-76c1-4dbb-a60c-57c8a9a269e5"}], "security_groups": [{"name": "tempest-securitygroup--1692588209"}], "key_name": "tempest-keypair-976134965", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:08:56.147244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8293c935-4fed-424b-a30b-489b74134fe3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:56.147854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8293c935-4fed-424b-a30b-489b74134fe3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:56.220728 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8293c935-4fed-424b-a30b-489b74134fe3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:56.230094 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8293c935-4fed-424b-a30b-489b74134fe3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1214 microversion: 2.1 time: 0.086391 Nov 11 01:08:56.230699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 452/894] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:56 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:08:56.243316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] validate_networks() for [('7db40340-76c1-4dbb-a60c-57c8a9a269e5', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:08:56.604548 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:08:56.604976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:08:56.605449 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:08:56.605859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:08:56.606296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:08:56.615218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:56.615693 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:56.616489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:56.616941 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:56.633922 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for project e01554f5a96c46afb1983c71a9513e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:08:56.637504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Getting quotas for user 4d1219c765c74dcc8bb8b61d4615e0c6 and project e01554f5a96c46afb1983c71a9513e16. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:08:56.648981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:08:56.651191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:08:56.697515 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-afa0e229-d608-4953-bc84-5b95b98c7faa tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.588264 Nov 11 01:08:56.698296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 443/895] 10.222.0.52 () {62 vars in 1187 bytes} [Thu Nov 11 01:08:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 11 01:08:56.708642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-aabace19-b200-487d-9957-cd22a6bed94a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:56.709930 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-aabace19-b200-487d-9957-cd22a6bed94a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:56.764549 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aabace19-b200-487d-9957-cd22a6bed94a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:56.772204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aabace19-b200-487d-9957-cd22a6bed94a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:56.773701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aabace19-b200-487d-9957-cd22a6bed94a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:56.774880 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-aabace19-b200-487d-9957-cd22a6bed94a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1280 microversion: 2.20 time: 0.070225 Nov 11 01:08:56.775549 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 453/896] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:56 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:57.247826 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b34f4177-21c4-49a0-97c8-3d6e7190378e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:57.248383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b34f4177-21c4-49a0-97c8-3d6e7190378e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:57.297789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b34f4177-21c4-49a0-97c8-3d6e7190378e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:57.306523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b34f4177-21c4-49a0-97c8-3d6e7190378e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1214 microversion: 2.1 time: 0.062884 Nov 11 01:08:57.307104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 444/897] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:57 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:57.792495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:57.793100 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:57.799866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:57.800334 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:57.801116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:57.801553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:57.860262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:57.867905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:57.869407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:57.870538 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2c833c0b-c1a7-4b2d-8ead-b40c65de885b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1284 microversion: 2.20 time: 0.081768 Nov 11 01:08:57.871137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 454/898] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:57 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:08:58.323015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3a681dd9-c8aa-4a4c-94a5-a6f6c90675fc tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:58.323625 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3a681dd9-c8aa-4a4c-94a5-a6f6c90675fc tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:58.373433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3a681dd9-c8aa-4a4c-94a5-a6f6c90675fc tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:58.380886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3a681dd9-c8aa-4a4c-94a5-a6f6c90675fc tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1214 microversion: 2.1 time: 0.060993 Nov 11 01:08:58.381173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 445/899] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:58 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1214 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:08:58.889051 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:58.889591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:58.895910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:58.896359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:58.897260 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:58.897654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:58.967047 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:58.975804 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:58.977308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:58.978419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-68b421dd-8f26-4119-ad7f-0847f32625c6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1284 microversion: 2.20 time: 0.093354 Nov 11 01:08:58.979006 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 455/900] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:58 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:08:59.244095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:59.244585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:59.250842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:59.251322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:59.252096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:59.252530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:59.329454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lazy-loading 'services' on Instance uuid 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:08:59.398816 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:59.399385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:08:59.399517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9c281a3c-f0ca-47ce-8610-c5ead0816b58 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-volume_attachments/a5cc127d-7269-498d-ada7-1258a4dddfaa" status: 202 len: 0 microversion: 2.1 time: 0.266371 Nov 11 01:08:59.400099 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 446/901] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:08:59 2021] DELETE /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-volume_attachments/a5cc127d-7269-498d-ada7-1258a4dddfaa => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:08:59.406330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:59.406776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:59.407822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:08:59.410976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:08:59.479732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:08:59.487517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c5a3f921-7558-40b7-92fb-c6b0e5015217 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1218 microversion: 2.1 time: 0.094031 Nov 11 01:08:59.488673 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 456/902] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:08:59 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:08:59.997208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:08:59.998110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:00.006762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:00.007249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:00.008056 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:00.008495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:00.077540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:00.086093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:00.087706 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:00.088808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cbda74a5-6946-4e05-b478-412be6ca0d5c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1338 microversion: 2.20 time: 0.095676 Nov 11 01:09:00.089368 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 447/903] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:08:59 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:00.516076 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:00.516952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:00.523749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:00.524269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:00.525114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:00.525635 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:00.611339 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:00.620482 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d669a162-5820-4635-b0e0-ffe1860d75af tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1266 microversion: 2.1 time: 0.118803 Nov 11 01:09:00.631192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 457/904] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:00 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:01.109186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:01.110097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:01.119212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.120037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:01.122082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.122632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:01.583780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-798cd86d-0505-4cd8-874e-43881aa7b48e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:01.591754 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-798cd86d-0505-4cd8-874e-43881aa7b48e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.594031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-798cd86d-0505-4cd8-874e-43881aa7b48e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:01.626288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:01.638848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:01.641141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:01.642550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a1ab5c11-53b2-4e25-be8a-9e029bd13929 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.537708 Nov 11 01:09:01.643309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 448/905] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:01 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:01.650118 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-798cd86d-0505-4cd8-874e-43881aa7b48e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Going to try to stop instance {{(pid=116015) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 11 01:09:01.661558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:01.662831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:01.679232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.679784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:01.680690 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.681224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:01.729471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-798cd86d-0505-4cd8-874e-43881aa7b48e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.150444 Nov 11 01:09:01.732227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 458/906] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:09:01 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:09:01.760145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:01.763503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:01.770703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.771329 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:01.772247 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:01.772780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:02.028901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:02.036839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7327ea53-8e64-41a1-b88e-339a5101bb45 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.288341 Nov 11 01:09:02.047876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 459/907] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:01 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:02.053117 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-2f233dc5-0bdf-4b60-912c-7b6a9612860d req-00fbe572-e7ef-4cc4-9c24-f2a63f201a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:02.054724 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:02.054724 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:09:02.061638 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-2f233dc5-0bdf-4b60-912c-7b6a9612860d req-00fbe572-e7ef-4cc4-9c24-f2a63f201a37 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:02.062085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-2f233dc5-0bdf-4b60-912c-7b6a9612860d req-00fbe572-e7ef-4cc4-9c24-f2a63f201a37 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:02.073760 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-2f233dc5-0bdf-4b60-912c-7b6a9612860d req-00fbe572-e7ef-4cc4-9c24-f2a63f201a37 service nova] Creating event network-changed:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:09:02.075083 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:02.078668 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-2f233dc5-0bdf-4b60-912c-7b6a9612860d req-00fbe572-e7ef-4cc4-9c24-f2a63f201a37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029205 Nov 11 01:09:02.079612 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 460/908] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:02.091433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6e5dce63-ee5f-43dc-a93c-1a5ffbfc7326 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.446686 Nov 11 01:09:02.095642 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 449/909] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:01 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:02.665526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:02.667253 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:02.674574 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:02.675352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:02.676586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:02.677015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:02.781483 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-998b5bfc-4414-4536-8fd4-c826cdd1b2f7 req-5de72be0-a188-428f-a86f-9a1a608036c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880b8450-ebb8-458b-8b2f-fc32ae59e2ea", "tag": "1095182b-db09-41e9-9134-176f61f346be"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:02.785722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:02.785722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:09:02.794050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-998b5bfc-4414-4536-8fd4-c826cdd1b2f7 req-5de72be0-a188-428f-a86f-9a1a608036c3 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:02.795239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-998b5bfc-4414-4536-8fd4-c826cdd1b2f7 req-5de72be0-a188-428f-a86f-9a1a608036c3 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:02.812550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-998b5bfc-4414-4536-8fd4-c826cdd1b2f7 req-5de72be0-a188-428f-a86f-9a1a608036c3 service nova] Creating event network-changed:1095182b-db09-41e9-9134-176f61f346be for instance 880b8450-ebb8-458b-8b2f-fc32ae59e2ea on hv-cinder-81708 Nov 11 01:09:02.836700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-998b5bfc-4414-4536-8fd4-c826cdd1b2f7 req-5de72be0-a188-428f-a86f-9a1a608036c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061263 Nov 11 01:09:02.838027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 450/910] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:09:02.913993 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:02.924854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:02.928056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:02.929257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e098839c-de63-4e87-baba-4285d21d56c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.270876 Nov 11 01:09:02.937914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 461/911] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:02 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:03.054298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:03.055041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:03.061059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:03.061516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:03.062303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:03.062741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:03.108947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:03.109713 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:03.116526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:03.117110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:03.118005 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:03.118551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:03.291672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:03.299058 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-90fc972e-556b-40a7-a165-de4c71fc39d3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.248877 Nov 11 01:09:03.299963 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 451/912] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:03 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:03.377315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:03.385197 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8ab2aa72-75e0-4781-9b44-8583f8094e69 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.279861 Nov 11 01:09:03.385765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 462/913] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:03 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:03.949338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:03.950310 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:03.957786 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:03.958647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:03.959712 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:03.960603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:04.164600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:04.172200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:04.173677 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:04.174788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cb3c2945-2ed5-4c84-91ca-2458a95a2191 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.229140 Nov 11 01:09:04.175431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 452/914] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:03 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:04.317588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:04.324179 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:04.337605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:04.338213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:04.339806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:04.340583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:04.401719 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:04.402531 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:04.409533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:04.409995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:04.411006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:04.411447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:04.561279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:04.570962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a52d93bc-cb0b-44bf-8aa9-17d38d592e3d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.258016 Nov 11 01:09:04.571646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 463/915] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:04 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:04.591728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:04.599334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f34ce27a-479f-462b-a5ce-b221104eeca6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.201415 Nov 11 01:09:04.599904 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 453/916] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:04 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:05.191552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:05.192115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:05.197803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:05.198249 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:05.199054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:05.199493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:05.339976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:05.351979 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:05.353490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:05.354596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-146236c6-fc08-4851-8b8e-677f4ff4c250 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.166789 Nov 11 01:09:05.355181 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 464/917] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:05 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:05.588579 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:05.589247 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:05.595620 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:05.596061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:05.596849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:05.597283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:05.615440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:05.616274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:05.622677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:05.623168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:05.624139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:05.624575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:05.804728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:05.808146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:05.813069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a0e2c18f-885e-4260-9e18-f8aed7631f41 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.228000 Nov 11 01:09:05.814023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 454/918] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:05 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:05.815907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9e55b3df-8945-4f76-8314-f97a0abdf4a3 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.204059 Nov 11 01:09:05.825600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 465/919] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:05 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:06.372357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:06.372981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:06.380365 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:06.380808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:06.381607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:06.382032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:06.536322 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:06.546545 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:06.548304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:06.549600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fe64bb0b-2bb8-4bb7-ac5a-b509502463d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.180929 Nov 11 01:09:06.550159 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 455/920] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:06 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:06.831635 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:06.832365 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:06.834323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:06.835922 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:06.839841 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:06.840374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:06.841062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:06.841560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:06.843953 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:06.844460 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:06.845533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:06.845970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:07.117922 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:07.135323 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9c3d2408-9dae-4339-b04d-01c04ba443a3 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.308220 Nov 11 01:09:07.144129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 466/921] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:06 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:07.145895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:07.171022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-62f76116-a526-4d17-87c5-d849e555f63a tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.340607 Nov 11 01:09:07.172739 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 456/922] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:06 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:07.571160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:07.571775 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:07.577765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:07.578244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:07.579038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:07.579475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:07.721974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:07.732327 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:07.733846 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:07.734982 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-459eee80-ac86-4d46-aa49-c17d4b691eba tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.167655 Nov 11 01:09:07.735605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 467/923] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:07 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:08.162126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:08.162700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:08.169215 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:08.169909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:08.170685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:08.171299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:08.198277 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:08.200075 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:08.207984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:08.208665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:08.209693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:08.210322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:08.396475 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:08.403909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-811bd587-5503-4454-9008-fe4be17d58f8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.246103 Nov 11 01:09:08.404479 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 457/924] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:08 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:08.408195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:08.416292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-63378a6d-bc88-482f-a243-981fc4056d30 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.223099 Nov 11 01:09:08.416845 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 468/925] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:08 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:08.752562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:08.753253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:08.759823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:08.760268 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:08.761035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:08.761508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:08.892862 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:08.901420 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:08.903066 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:08.904252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-62df30dc-7964-4237-8421-f7cc5ee6e8e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.155481 Nov 11 01:09:08.904994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 458/926] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:08 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:09.421226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:09.422021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:09.431217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:09.431418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:09.432173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:09.432599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:09.436989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:09.437694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:09.444465 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:09.444919 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:09.445753 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:09.446135 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:09.645395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:09.649561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:09.653595 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cb34a269-4fec-4a01-9f3e-2fd9edb537e2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.236018 Nov 11 01:09:09.654286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 469/927] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:09 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:09.657636 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fdf191f7-5125-48cd-8d1c-5c4b4cab4f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.228678 Nov 11 01:09:09.668104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 459/928] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:09 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:09.922087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:09.922711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:09.928892 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:09.929525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:09.930346 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:09.930776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:10.072772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:10.080428 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:10.082458 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:10.083601 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b3221ef1-bf17-408f-b679-505863a8f0e6 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.165779 Nov 11 01:09:10.084174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 470/929] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:09 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:10.672388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:10.673006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:10.674482 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:10.675310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:10.681598 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:10.682386 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:10.682633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:10.683141 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:10.683488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:10.683932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:10.684042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:10.684365 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:10.883272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:10.889236 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:10.896965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-952aee43-2b99-4bc4-9cd4-f8f9cf0f22fd tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.225988 Nov 11 01:09:10.897167 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2716af86-d7eb-4197-92b7-8dbc2a194802 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.228449 Nov 11 01:09:10.897653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 471/930] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:10 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:10.907069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 460/931] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:10 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:11.103257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:11.103938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:11.109951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.110480 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:11.111282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.111710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:11.273274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:11.281722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-00bb6a0f-d6e3-4374-85c5-4ab3d0c95da6 req-1ced2446-b1ac-4c74-80b4-7b0c9bfbbd7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "name": "network-vif-plugged", "status": "completed", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:11.285416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:11.285416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:09:11.292863 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-00bb6a0f-d6e3-4374-85c5-4ab3d0c95da6 req-1ced2446-b1ac-4c74-80b4-7b0c9bfbbd7a service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.293302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-00bb6a0f-d6e3-4374-85c5-4ab3d0c95da6 req-1ced2446-b1ac-4c74-80b4-7b0c9bfbbd7a service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:11.293729 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:11.295434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:11.296665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-77c15049-b683-4d3f-aa63-71f7495e5fa4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.198072 Nov 11 01:09:11.297326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 472/932] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:11 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:11.315395 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-00bb6a0f-d6e3-4374-85c5-4ab3d0c95da6 req-1ced2446-b1ac-4c74-80b4-7b0c9bfbbd7a service nova] Creating event network-vif-plugged:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:09:11.321027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-00bb6a0f-d6e3-4374-85c5-4ab3d0c95da6 req-1ced2446-b1ac-4c74-80b4-7b0c9bfbbd7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203420 Nov 11 01:09:11.322205 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 461/933] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:09:11.914188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:11.914802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:11.921703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.922154 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:11.922938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.923094 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:11.923535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:11.924411 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:11.931606 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.932051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:11.932833 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:11.933281 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:12.141530 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:12.144967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:12.152059 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d6ffa2b1-e78d-4aa5-8a0a-8c88d9c14a61 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.241380 Nov 11 01:09:12.153024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 473/934] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:11 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:12.160297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6e478c49-d9fc-4489-b05d-39bc7e983b3f tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.240786 Nov 11 01:09:12.161361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 462/935] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:11 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:12.315174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:12.315782 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:12.322312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:12.323165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:12.324446 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:12.325101 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:12.473542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:12.482468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:12.484074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:12.485495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-51479ffb-fd09-472f-a2d3-94085772096f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1406 microversion: 2.20 time: 0.174164 Nov 11 01:09:12.497267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 474/936] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:12 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:13.173910 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:13.174710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:13.181145 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:13.181640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.181895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.182674 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.182887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:13.183142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.189784 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.190228 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.191540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.192634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.393474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:13.395543 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:13.401626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-506cc90d-5ffe-42ec-a4ab-b2e63b675ceb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.231772 Nov 11 01:09:13.405459 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f9d1237c-8bd7-4d46-855b-fdea7b9b527b tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.231053 Nov 11 01:09:13.406390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 475/937] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:13 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:13.411877 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-a3dcfd07-7ace-4373-8837-8381a3c053fb req-d6b14d96-3bfa-4719-855f-e4ae4f874fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880b8450-ebb8-458b-8b2f-fc32ae59e2ea", "name": "network-vif-plugged", "status": "completed", "tag": "1095182b-db09-41e9-9134-176f61f346be"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:13.413009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 463/938] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:13 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:13.415599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:13.415599 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:09:13.423170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-a3dcfd07-7ace-4373-8837-8381a3c053fb req-d6b14d96-3bfa-4719-855f-e4ae4f874fde service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.423677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-a3dcfd07-7ace-4373-8837-8381a3c053fb req-d6b14d96-3bfa-4719-855f-e4ae4f874fde service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.437093 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-a3dcfd07-7ace-4373-8837-8381a3c053fb req-d6b14d96-3bfa-4719-855f-e4ae4f874fde service nova] Creating event network-vif-plugged:1095182b-db09-41e9-9134-176f61f346be for instance 880b8450-ebb8-458b-8b2f-fc32ae59e2ea on hv-cinder-81708 Nov 11 01:09:13.442735 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-a3dcfd07-7ace-4373-8837-8381a3c053fb req-d6b14d96-3bfa-4719-855f-e4ae4f874fde service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Nov 11 01:09:13.443698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 476/939] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:13.505851 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:13.506608 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:13.512861 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.513666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.514824 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.515514 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.666823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:13.676037 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:13.677469 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:13.678689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5f26f8ec-fbda-4aba-9aaa-528ffbb2e529 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1598 microversion: 2.20 time: 0.177529 Nov 11 01:09:13.679454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 464/940] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:09:13 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:09:13.696936 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:13.697825 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:13.704098 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.705105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.707056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:13.708315 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:13.799033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5c5d6b50-467a-4c65-8ad9-44ce1dd04da8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106184 Nov 11 01:09:13.799822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 477/941] 10.222.0.52 () {60 vars in 1315 bytes} [Thu Nov 11 01:09:13 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:09:14.422068 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:14.422792 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:14.424190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:14.424768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:14.434241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:14.434688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:14.435595 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:14.436605 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:14.436899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:14.437029 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:14.439396 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:14.439936 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:15.061299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:15.069406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0211556e-4055-4d45-98bd-c6e1a30d5d80 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.651878 Nov 11 01:09:15.069984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 465/942] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:14 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:15.081198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:15.090029 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3e84f059-8896-4298-b2c1-ba3bace54f42 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1314 microversion: 2.1 time: 0.669803 Nov 11 01:09:15.092652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 478/943] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:14 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:15.391046 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:15.392094 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:15.398211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-7897890c-d5a2-4f5a-9b05-d4762b50a569 req-5d89a446-5212-4968-9583-978174d51dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:15.401425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:15.401425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:09:15.409744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:15.413125 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:15.414171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:15.415460 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:15.417085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-7897890c-d5a2-4f5a-9b05-d4762b50a569 req-5d89a446-5212-4968-9583-978174d51dc7 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:15.420268 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-7897890c-d5a2-4f5a-9b05-d4762b50a569 req-5d89a446-5212-4968-9583-978174d51dc7 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:15.447430 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-7897890c-d5a2-4f5a-9b05-d4762b50a569 req-5d89a446-5212-4968-9583-978174d51dc7 service nova] Creating event network-changed:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:09:15.455230 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-7897890c-d5a2-4f5a-9b05-d4762b50a569 req-5d89a446-5212-4968-9583-978174d51dc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061598 Nov 11 01:09:15.460690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 479/944] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:15.564171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-df401d98-3b88-401b-b943-8e0854668101 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.175502 Nov 11 01:09:15.566492 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 466/945] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:15 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:16.086738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:16.087734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:16.096836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:16.099522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:16.105516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:16.106163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:16.115578 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:16.118411 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:16.140041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:16.141294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:16.142999 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:16.143667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:16.359396 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:16.378241 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8bef60ed-50c9-4cb2-8933-5b06641dd4b9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1677 microversion: 2.1 time: 0.295456 Nov 11 01:09:16.379989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 480/946] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:16 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1677 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:16.538316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:16.546964 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4e04b053-513f-4641-b603-2aec29c47200 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1499 microversion: 2.1 time: 0.440233 Nov 11 01:09:16.562009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 467/947] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:16 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1499 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:16.577665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:16.579580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:16.592858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:16.593323 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:16.594147 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:16.594576 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:16.719649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4f1dbfcc-0e6d-4275-9c3f-c8c6eb43ffec tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.146202 Nov 11 01:09:16.727225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 481/948] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:16 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:17.222017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:17.223224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:17.230430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.231098 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.232257 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.232968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.263854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:09:17.311805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:09:17.312694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:09:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:09:17.359067 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a8463ebe-904e-40df-a992-feef13c61718 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "DELETE /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 204 len: 0 microversion: 2.1 time: 0.140015 Nov 11 01:09:17.359597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 468/949] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:09:17 2021] DELETE /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:09:17.368740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:17.369575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:17.376852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.377010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.377793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.378278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.399269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:17.399269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:17.409843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.409843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.411063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.411545 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.566577 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:17.579854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b498e573-67d8-4b0b-9ac0-e32b261818d4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1505 microversion: 2.1 time: 0.215045 Nov 11 01:09:17.581119 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 482/950] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:17 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:17.649345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:17.661049 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e2c8a652-09b5-4fa7-b8a6-aac8730d69fc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1654 microversion: 2.1 time: 0.267020 Nov 11 01:09:17.672620 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 469/951] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:17 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1654 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:17.679743 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f6a09ff8-3ad7-4785-a3e2-d09c20b16838 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:17.688628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6a09ff8-3ad7-4785-a3e2-d09c20b16838 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.689333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f6a09ff8-3ad7-4785-a3e2-d09c20b16838 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.715335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f6a09ff8-3ad7-4785-a3e2-d09c20b16838 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Going to try to start instance {{(pid=116015) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 11 01:09:17.736997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:17.738835 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:17.745787 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.746242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.747115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.747759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.769068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f6a09ff8-3ad7-4785-a3e2-d09c20b16838 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.093866 Nov 11 01:09:17.770453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 483/952] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:09:17 2021] POST /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:17.784225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:17.785738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:17.792571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.793088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.793964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:17.794462 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:17.863495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-357059dd-fe36-410c-835a-cf17fb8f27f8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.130000 Nov 11 01:09:17.864793 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 470/953] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:17 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:17.958245 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:17.972226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c35faa52-61f0-4707-ae52-22e7bf27f7ba tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1663 microversion: 2.1 time: 0.197560 Nov 11 01:09:17.973310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 484/954] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:17 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:18.598791 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:18.600099 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:18.617955 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:18.618699 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:18.619694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:18.620287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:18.874335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:18.875280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:18.882312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:18.882994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:18.883946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:18.884545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:18.899562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:18.920245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c43b61ab-b267-45a9-9f67-5acec0c48e4c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1505 microversion: 2.1 time: 0.325622 Nov 11 01:09:18.922104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 471/955] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:18 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:18.990798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:18.991616 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:18.999684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:19.000478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:19.001492 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:19.002188 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:19.013149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a8c23b89-fa4f-40ff-958f-5e7a2abe3d35 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.142276 Nov 11 01:09:19.013783 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 485/956] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:18 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:19.259585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:19.270561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d38e5088-7e15-47c0-8e7d-d284eed434f0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1663 microversion: 2.1 time: 0.283011 Nov 11 01:09:19.275448 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 472/957] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:18 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1663 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:19.949360 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:19.951505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:19.964697 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:19.965394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:19.967227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:19.968235 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:20.024789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:20.026257 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:20.039992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:20.048882 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:20.050202 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:20.054199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:20.235257 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fa8db215-f9c0-498d-b68f-df5b1bead2a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.214033 Nov 11 01:09:20.237210 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 473/958] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:20 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:20.292863 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:20.293805 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:20.301013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:20.301689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:20.302644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:20.303263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:20.430108 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:20.454264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-319e0eac-6a47-47ca-8580-025eca4c2b10 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 200 len: 1505 microversion: 2.1 time: 0.516499 Nov 11 01:09:20.457633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 486/959] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:19 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:20.469728 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-badc10b6-dcb5-445c-b093-c67812371104 req-59b3a1f6-be59-4ddb-a535-cad2b0778800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880b8450-ebb8-458b-8b2f-fc32ae59e2ea", "name": "network-vif-deleted", "tag": "1095182b-db09-41e9-9134-176f61f346be"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:20.475721 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:20.475721 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:09:20.495227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-badc10b6-dcb5-445c-b093-c67812371104 req-59b3a1f6-be59-4ddb-a535-cad2b0778800 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:20.498172 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-badc10b6-dcb5-445c-b093-c67812371104 req-59b3a1f6-be59-4ddb-a535-cad2b0778800 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:20.530964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-badc10b6-dcb5-445c-b093-c67812371104 req-59b3a1f6-be59-4ddb-a535-cad2b0778800 service nova] Creating event network-vif-deleted:1095182b-db09-41e9-9134-176f61f346be for instance 880b8450-ebb8-458b-8b2f-fc32ae59e2ea on hv-cinder-81708 Nov 11 01:09:20.538848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-badc10b6-dcb5-445c-b093-c67812371104 req-59b3a1f6-be59-4ddb-a535-cad2b0778800 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077869 Nov 11 01:09:20.550428 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 487/960] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:20.638649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:20.646781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-78b6b344-8b95-4902-bfd1-6c889427f4be tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1667 microversion: 2.1 time: 0.358204 Nov 11 01:09:20.647402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 474/961] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:20 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:21.250423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:21.254140 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:21.261107 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:21.261678 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:21.262927 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:21.264290 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:21.367636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-76ed42b1-13d1-448d-8a7d-7d9ef71df49c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.122241 Nov 11 01:09:21.369583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 488/962] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:21 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:21.477693 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:21.478768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 880b8450-ebb8-458b-8b2f-fc32ae59e2ea] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:21.485252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:21.485841 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:21.486820 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:21.487355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:21.504565 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] HTTP exception thrown: Instance 880b8450-ebb8-458b-8b2f-fc32ae59e2ea could not be found. Nov 11 01:09:21.505421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Returning 404 to user: Instance 880b8450-ebb8-458b-8b2f-fc32ae59e2ea could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:09:21.506264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e2be151c-51ba-4ba0-af13-048163db8ee8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea" status: 404 len: 111 microversion: 2.1 time: 0.032429 Nov 11 01:09:21.507005 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 475/963] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:21 2021] GET /compute/v2.1/servers/880b8450-ebb8-458b-8b2f-fc32ae59e2ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:09:21.640378 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1931432700", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "networks": [{"uuid": "0a5aa8d3-8b8d-40ef-b7b2-1f6fcc263384"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:21.703436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] validate_networks() for [('0a5aa8d3-8b8d-40ef-b7b2-1f6fcc263384', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:09:22.379529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:22.380740 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:22.387618 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:22.388641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:22.390002 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:22.390871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:22.483465 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-38857c66-acd2-444a-9a5c-cb4a47f570af tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.107847 Nov 11 01:09:22.485286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 476/964] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:22 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:22.613752 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:09:22.614295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:09:22.614687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:09:22.615113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:09:22.615689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:09:22.624867 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:22.625551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:22.626526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:22.627165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:22.647803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Getting quotas for project 42eb5f73fb374af78bba48a01fee4398. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:09:22.652344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Getting quotas for user ff4d1564049544579728cc6109d99fe6 and project 42eb5f73fb374af78bba48a01fee4398. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:09:22.664458 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:09:22.666844 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:09:22.741703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d9d0b4ab-b126-4f5a-b15a-58d8cfe14c5c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105174 Nov 11 01:09:22.747336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 489/965] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:09:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:09:22.756465 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-92992bfe-ba73-431a-8ed6-cf7995af3dfa tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:22.757309 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-92992bfe-ba73-431a-8ed6-cf7995af3dfa tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:22.834248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-92992bfe-ba73-431a-8ed6-cf7995af3dfa tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:22.843687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-92992bfe-ba73-431a-8ed6-cf7995af3dfa tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1214 microversion: 2.1 time: 0.093664 Nov 11 01:09:22.845437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 477/966] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:22 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:23.498634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:23.499917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:23.508814 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:23.510350 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:23.511394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:23.511872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:23.643360 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-41657ebf-f6d9-4609-b138-b7b1480082f5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.151161 Nov 11 01:09:23.645373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 490/967] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:23 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:23.863947 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:23.864607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:23.871267 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:23.871721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:23.872557 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:23.872995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:23.993979 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:24.007789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cc8bf406-15cd-4a15-a4ea-391c400ef985 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1266 microversion: 2.1 time: 0.147397 Nov 11 01:09:24.019688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 478/968] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:23 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:24.657941 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:24.660702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:24.687489 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:24.688337 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:24.689410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:24.690090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:24.829918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0c8c2130-5881-42f9-b856-7c0191f8348a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.177291 Nov 11 01:09:24.837915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 491/969] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:24 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:25.035852 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:25.038456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:25.060280 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:25.060759 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:25.061766 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:25.063421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:25.244965 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:25.256649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-31290802-908b-4c8e-872f-0470028777c1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.229013 Nov 11 01:09:25.257980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 479/970] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:25 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:25.846236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:25.849348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:25.862077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:25.863590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:25.865027 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:25.865883 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:25.915328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-0316219d-c5bb-4da3-a03f-d7c91e551a14 req-b262b435-c1a4-4511-a1e1-39c934b9a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916da15a-2905-49a9-84dc-4bccf2f8f4a5", "tag": "4ad1c4c9-70f2-41c2-823a-a2515ce5751e"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:25.917061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:25.917061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:09:25.927348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-0316219d-c5bb-4da3-a03f-d7c91e551a14 req-b262b435-c1a4-4511-a1e1-39c934b9a4cc service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:25.928041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-0316219d-c5bb-4da3-a03f-d7c91e551a14 req-b262b435-c1a4-4511-a1e1-39c934b9a4cc service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:25.939153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-0316219d-c5bb-4da3-a03f-d7c91e551a14 req-b262b435-c1a4-4511-a1e1-39c934b9a4cc service nova] Creating event network-changed:4ad1c4c9-70f2-41c2-823a-a2515ce5751e for instance 916da15a-2905-49a9-84dc-4bccf2f8f4a5 on hv-cinder-81708 Nov 11 01:09:25.944521 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-0316219d-c5bb-4da3-a03f-d7c91e551a14 req-b262b435-c1a4-4511-a1e1-39c934b9a4cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 Nov 11 01:09:25.947892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 480/971] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:09:26.015656 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8e327e62-4ed4-4897-8b6c-d8ddce5bd881 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 14 microversion: 2.20 time: 0.173764 Nov 11 01:09:26.017024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 492/972] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:25 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:26.277628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:26.278343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:26.285772 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:26.286219 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:26.287261 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:26.287992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:26.457504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:26.470278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3df0a1f1-f619-4dc2-a52b-a45fdbb497a8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.196762 Nov 11 01:09:26.471395 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 481/973] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:26 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:27.030397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:27.033033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:27.043150 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:27.043852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:27.044806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:27.045397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:27.174464 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8f0e01e7-da34-4eca-a625-b720e87c7ed7 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 647 microversion: 2.20 time: 0.149961 Nov 11 01:09:27.175712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 493/974] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:27 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 647 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:09:27.488694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:27.489982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:27.496515 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:27.497028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:27.497873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:27.498383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:27.668447 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:27.676413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4af7c3c4-9aa2-41bf-b974-bc780e53b2c5 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.192379 Nov 11 01:09:27.677631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 482/975] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:27 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:28.186403 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:28.188069 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:28.199731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:28.200410 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:28.201353 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:28.201938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:28.317810 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-534866e6-bea1-42c9-a40f-bb7ec17b4e81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 11132 microversion: 2.20 time: 0.135414 Nov 11 01:09:28.319112 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 494/976] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:28 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 11132 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:28.694931 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:28.695476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:28.704296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:28.705069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:28.706823 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:28.708213 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:28.923857 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:28.931955 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fb1866ce-58fa-4bc1-b01f-427059e4c0bb tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.241616 Nov 11 01:09:28.934141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 483/977] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:28 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:29.330682 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:29.332910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:29.348373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:29.349003 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:29.349974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:29.351345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:29.466008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2feb6500-55d0-4a0c-8c30-38c6d9b159c8 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 16319 microversion: 2.20 time: 0.139286 Nov 11 01:09:29.466620 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 495/978] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:29 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 16319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:29.951496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:29.952865 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:29.960364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:29.961047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:29.961998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:29.962597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:30.125660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:30.133292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-108ba5a4-242f-49f9-8a60-f425b941abd2 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.187572 Nov 11 01:09:30.133861 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 484/979] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:29 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:30.479843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:30.480994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:30.506628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:30.509910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:30.510905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:30.511375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:30.680551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-50cffe7e-a2cc-4001-addc-466eb0703ccc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 18013 microversion: 2.20 time: 0.204924 Nov 11 01:09:30.681198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 496/980] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:30 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 18013 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:31.149315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:31.150525 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:31.157038 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:31.157734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:31.158725 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:31.159999 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:31.323319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:31.331151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-665954d5-06ff-425d-b73e-abd730da2751 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.185361 Nov 11 01:09:31.332224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 485/981] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:31 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:31.695482 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:31.696492 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:31.703437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:31.703887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:31.704848 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:31.705300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:31.845330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-db986580-8952-4f6f-a636-47c928f6c798 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 19342 microversion: 2.20 time: 0.156661 Nov 11 01:09:31.850375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 497/982] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:31 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 19342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:09:32.348463 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:32.349062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:32.356092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:32.356849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:32.357861 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:32.358358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:32.502634 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:32.510534 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-60249ac3-2923-4fe9-915f-b479719c35bf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.166281 Nov 11 01:09:32.511133 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 486/983] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:32 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:32.858533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:32.859590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:32.867718 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:32.868164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:32.869159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:32.869806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:32.995294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b1b3d040-773e-4fc3-8130-3890e608c439 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 21519 microversion: 2.20 time: 0.140793 Nov 11 01:09:32.995943 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 498/984] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:32 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 21519 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:33.309190 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-7a2d6f3b-171f-4cca-b1ec-70809f252187 req-6beb44a4-a743-43dd-b832-d358aced7f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916da15a-2905-49a9-84dc-4bccf2f8f4a5", "name": "network-vif-plugged", "status": "completed", "tag": "4ad1c4c9-70f2-41c2-823a-a2515ce5751e"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:33.310682 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:33.310682 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:09:33.317838 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7a2d6f3b-171f-4cca-b1ec-70809f252187 req-6beb44a4-a743-43dd-b832-d358aced7f12 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:33.318622 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-7a2d6f3b-171f-4cca-b1ec-70809f252187 req-6beb44a4-a743-43dd-b832-d358aced7f12 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:33.330504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-7a2d6f3b-171f-4cca-b1ec-70809f252187 req-6beb44a4-a743-43dd-b832-d358aced7f12 service nova] Creating event network-vif-plugged:4ad1c4c9-70f2-41c2-823a-a2515ce5751e for instance 916da15a-2905-49a9-84dc-4bccf2f8f4a5 on hv-cinder-81708 Nov 11 01:09:33.335952 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-7a2d6f3b-171f-4cca-b1ec-70809f252187 req-6beb44a4-a743-43dd-b832-d358aced7f12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 Nov 11 01:09:33.336770 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 487/985] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:33.529384 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:33.530191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:33.538583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:33.539054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:33.539828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:33.540451 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:33.540902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5f96228b-d21d-44b8-a072-297597676814 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Action: 'create', calling method: .version_select at 0x7fd36414baf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1630132196"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:33.554938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-5f96228b-d21d-44b8-a072-297597676814 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Getting quotas for project c7abb9f19d954ab1b034c3bc7de8d24b. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:09:33.558746 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-5f96228b-d21d-44b8-a072-297597676814 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Getting quotas for user 7179c255c5cf4dfca1ed17c80004dd77 and project c7abb9f19d954ab1b034c3bc7de8d24b. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:09:33.681569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:33.683333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-5f96228b-d21d-44b8-a072-297597676814 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Getting quotas for project c7abb9f19d954ab1b034c3bc7de8d24b. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:09:33.686921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-5f96228b-d21d-44b8-a072-297597676814 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Getting quotas for user 7179c255c5cf4dfca1ed17c80004dd77 and project c7abb9f19d954ab1b034c3bc7de8d24b. Resources: {'key_pairs'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:09:33.689293 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3d553aea-e80d-47e4-b2ee-16f190c155cf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.164802 Nov 11 01:09:33.690050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 499/986] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:33 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:33.701898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5f96228b-d21d-44b8-a072-297597676814 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.165301 Nov 11 01:09:33.702411 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 488/987] 10.222.0.52 () {60 vars in 1157 bytes} [Thu Nov 11 01:09:33 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:33.750903 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-760711922", "imageRef": "165a102f-769e-495a-920d-c50ed37175d6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1630132196", "networks": [{"uuid": "4e48f818-692b-4e8c-876c-8e3b508f3610"}]}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:33.800423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.network.neutron [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] validate_networks() for [('4e48f818-692b-4e8c-876c-8e3b508f3610', None, None, None, None, None)] {{(pid=116015) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:09:34.007649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:34.008802 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:34.014647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:34.015137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:34.015916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:34.016348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:34.144589 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-494569f8-c485-4661-b3c1-adba5789bfbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 22986 microversion: 2.20 time: 0.141425 Nov 11 01:09:34.145232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 489/988] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:34 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 22986 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:09:34.167350 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Flavor limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:09:34.167813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Image limits 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:09:34.168220 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Flavor pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:09:34.168621 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Image pref 0:0:0 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:09:34.169025 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.virt.hardware [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:09:34.178217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:34.178654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:34.179483 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:34.179958 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:34.195882 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Getting quotas for project c7abb9f19d954ab1b034c3bc7de8d24b. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:09:34.199663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Getting quotas for user 7179c255c5cf4dfca1ed17c80004dd77 and project c7abb9f19d954ab1b034c3bc7de8d24b. Resources: {'instances', 'ram', 'cores'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:09:34.209884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Going to run 1 instances... {{(pid=116015) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:09:34.212087 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='165a102f-769e-495a-920d-c50ed37175d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:09:34.258486 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f931434f-2648-4b1b-9523-01b0beaded33 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511099 Nov 11 01:09:34.259055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 500/989] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:09:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:09:34.269464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5c667a6c-67f3-48c4-851b-909cc6a60722 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:34.270242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5c667a6c-67f3-48c4-851b-909cc6a60722 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:34.324104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5c667a6c-67f3-48c4-851b-909cc6a60722 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:34.331718 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5c667a6c-67f3-48c4-851b-909cc6a60722 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1258 microversion: 2.1 time: 0.065955 Nov 11 01:09:34.332117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 490/990] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:34 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:34.708121 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:34.708795 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:34.716335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:34.716802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:34.717796 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:34.718242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:34.852618 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:34.859797 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6bfb7f6a-cde4-44de-8a04-5cf2f5e50398 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1314 microversion: 2.1 time: 0.156673 Nov 11 01:09:34.860358 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 501/991] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:34 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:35.157510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:35.158400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:35.166030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:35.166483 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:35.167361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:35.167804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:35.296091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-024fd17f-3cdd-48f3-ac09-b95f40ddf415 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 23804 microversion: 2.20 time: 0.144233 Nov 11 01:09:35.296781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 491/992] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:35 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 23804 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:09:35.349480 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:35.350085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:35.355990 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:35.356449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:35.357214 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:35.357640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:35.419557 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:35.427274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1d6d98a8-95c6-4ca7-9d68-f00c27d2ecc4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1310 microversion: 2.1 time: 0.082654 Nov 11 01:09:35.427837 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 502/993] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:35 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:35.876848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:35.878165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:35.887054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:35.887511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:35.888537 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:35.888987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.043550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:36.053468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1fbff60b-943f-4084-be06-6ee10bbcb8d8 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1498 microversion: 2.1 time: 0.180288 Nov 11 01:09:36.059434 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 492/994] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:35 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:36.309662 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:36.311496 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:36.328728 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.329177 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.329993 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.330436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.450605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:36.451528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:36.461809 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.463552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.464729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.466490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.636128 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:36.645221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0d35cdd0-1ee9-470c-949d-d3361d61ae7f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.203805 Nov 11 01:09:36.645873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 493/995] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:36 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:36.788522 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:36.789016 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:36.795536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.795989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.796763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.797191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.839783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:09:36.912884 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f23d359e-8f26-4c3b-94be-4a2b9fda4a78 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "DELETE /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 204 len: 0 microversion: 2.1 time: 0.128392 Nov 11 01:09:36.913475 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 494/996] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:09:36 2021] DELETE /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:09:36.922276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:36.923029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:36.932781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.933912 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:36.935400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:36.935957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:37.075295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:37.083227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-886aaec6-2459-4c61-acf5-315c107359c6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.164931 Nov 11 01:09:37.083797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 495/997] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:36 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:37.662871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:37.663583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:37.669611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:37.670054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:37.670813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:37.671344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:37.802398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:37.809553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-703f6930-3c78-4944-952e-2d18f35355de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.150970 Nov 11 01:09:37.811080 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 496/998] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:37 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:38.102115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:38.102714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:38.108545 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:38.108994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:38.109757 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:38.110192 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:38.253662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:38.261710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b01a5523-576e-4824-b799-5767632de2b7 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.163246 Nov 11 01:09:38.271741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 497/999] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:38 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:38.827238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:38.827876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:38.834744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:38.835216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:38.835985 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:38.836410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:38.979364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:38.988526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-519051b4-982e-4ed6-85e9-4cecd68b367f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.163601 Nov 11 01:09:38.989780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 498/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:38 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:39.279273 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:39.279913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:39.285973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:39.286418 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:39.287231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:39.287664 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:39.428021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:39.435800 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-14f321d6-d626-404d-ac3f-608464c67335 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.160167 Nov 11 01:09:39.437794 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 499/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:39 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:40.005842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:40.006444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:40.012858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:40.013298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:40.014057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:40.014484 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:40.154400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:40.162115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-801e4e04-4ef9-48ef-80d9-b37496ef885c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.160371 Nov 11 01:09:40.162686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 500/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:40 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:40.452566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:40.453354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:40.461437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:40.461904 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:40.462686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:40.463151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:40.597752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:40.605788 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a198a137-7c44-449b-8b10-6d68b2a969b4 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.157271 Nov 11 01:09:40.606349 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 501/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:40 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:41.179190 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:41.180579 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:41.187453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:41.188022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:41.189028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:41.190333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:41.330862 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:41.337889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f964229b-768b-4402-bb7a-993127ffb0f6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.162462 Nov 11 01:09:41.338451 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 502/1004] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:41 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:41.623270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:41.623862 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:41.630608 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:41.631086 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:41.631858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:41.632290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:41.768053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:41.775569 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9957cba7-0cd5-4dc7-85d7-5a0f7fd6e509 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.156026 Nov 11 01:09:41.776119 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 503/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:41 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:42.354510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:42.355223 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:42.361276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:42.362243 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:42.363011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:42.363442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:42.500879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:42.508212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3d4b8579-9110-439f-9b37-85fa4f38a58f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.157335 Nov 11 01:09:42.508773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 504/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:42 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:42.793372 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:42.794004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:42.799905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:42.800344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:42.801107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:42.801533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:42.935821 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:42.944429 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-af04b7af-2690-4cc4-a5d7-31bb6eb9d91c tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.154629 Nov 11 01:09:42.950015 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 505/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:42 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:43.525436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:43.526256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:43.532292 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:43.532739 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:43.533511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:43.534052 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:43.677993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:43.686619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5e3101a0-8f51-4b62-99c1-2ecca832fdc2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.164881 Nov 11 01:09:43.696946 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 506/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:43 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:43.962437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:43.963099 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:43.969898 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:43.970215 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:43.971294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:43.971732 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.113685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:44.121276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0ad44e13-4499-456d-b458-b99433d6ad26 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.162601 Nov 11 01:09:44.121836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 507/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:43 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:44.342191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:44.342735 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:44.349716 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:44.350165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.350975 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:44.351411 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.375194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lazy-loading 'flavor' on Instance uuid 93554b91-4f2b-4c98-ac74-341ac3c847f0 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:09:44.460340 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-44543540-f46c-4a65-b90c-1df78323b731 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "POST /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0/action" status: 202 len: 0 microversion: 2.1 time: 0.121964 Nov 11 01:09:44.463102 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 508/1010] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:09:44 2021] POST /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:44.470006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:44.470702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:44.477647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:44.478093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.478868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:44.479905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.616255 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:44.624419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1a8f143e-203d-4760-b81e-c6f10553ef84 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.158672 Nov 11 01:09:44.625175 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 509/1011] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:44 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:44.703909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:44.704542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:44.711749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:44.712200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.712972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:44.713441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:44.857444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:44.864726 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5c84a22f-2d9a-4e9d-9d19-2f8218cf9ac1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.164523 Nov 11 01:09:44.865226 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 510/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:44 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:45.138450 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:45.139034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:45.145762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:45.146302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:45.147074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:45.147573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:45.287360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:45.294905 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-deaebcb0-57d0-423d-8b1e-c18ddb6f7cd6 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.160189 Nov 11 01:09:45.295533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 511/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:45 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:45.643010 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:45.644098 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:45.651022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:45.651482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:45.652373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:45.652880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:45.794548 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:45.802169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3766e7d0-ef66-4e86-b494-0e785d51d8cb tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.162941 Nov 11 01:09:45.802868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 512/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:45 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:45.881103 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:45.881716 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:45.887552 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:45.888023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:45.888779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:45.889214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:46.027583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:46.035468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-be01052a-a224-47f7-947d-a7e320931685 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.158083 Nov 11 01:09:46.036029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 513/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:45 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:46.311878 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:46.312489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:46.318364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:46.318813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:46.319638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:46.320078 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:46.459890 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:46.467453 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ab938fdd-f510-46d8-87b3-281a93c7f2d1 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.159271 Nov 11 01:09:46.468013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 514/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:46 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:46.819974 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:46.820647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:46.826747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:46.827231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:46.827993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:46.828419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:46.981853 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:46.989777 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b261e0fa-99ce-44c2-9f9c-5b50b135cbbc tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.173448 Nov 11 01:09:46.990344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 515/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:46 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:47.052891 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:47.053499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:47.063725 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:47.064170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:47.066151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:47.066603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:47.201820 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:47.210179 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-be4a2013-e234-4369-ac83-970388fcbff9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.162011 Nov 11 01:09:47.210737 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 516/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:47 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:47.485546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:47.486066 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:47.492419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:47.492869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:47.493631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:47.494061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:47.639994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:47.648116 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-559bca49-0397-4796-904f-11c09dc83361 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.166289 Nov 11 01:09:47.648875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 517/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:47 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:48.006421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:48.007230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:48.013714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:48.014163 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:48.014937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:48.015436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:48.151185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:48.159106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-332aeff8-a3e2-47bb-bcbd-3a00a1f704ad tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.155671 Nov 11 01:09:48.159691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 518/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:48 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:48.227990 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:48.228513 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:48.234654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:48.235186 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:48.236116 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:48.236640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:48.375575 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:48.383710 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1d53806e-ac23-459a-8349-cf4c6231490c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.159468 Nov 11 01:09:48.384273 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 519/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:48 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:48.665220 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:48.665972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:48.671995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:48.672444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:48.673218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:48.673647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:48.812594 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:48.820632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c1e156b5-4f9e-411e-9bde-6cc363c6dbdf tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.159174 Nov 11 01:09:48.821193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 520/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:48 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:49.177360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:49.178056 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:49.184164 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:49.184605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:49.185361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:49.185785 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:49.320401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:49.327911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-531616f9-9611-463a-b295-785472986906 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.155611 Nov 11 01:09:49.328661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 521/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:49 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:49.401431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:49.402062 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:49.407867 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:49.408308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:49.409065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:49.410092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:49.543379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:49.550734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-396c852e-4e9c-403c-8d4e-08871c44d807 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.152877 Nov 11 01:09:49.551326 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 522/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:49 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:49.838286 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:49.838892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:49.844918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:49.845351 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:49.846106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:49.846529 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:49.975370 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:49.982613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7b2389e0-14f4-48bd-b2ee-b243dd75981e tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.148314 Nov 11 01:09:49.983198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 523/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:49 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:50.345098 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:50.345799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:50.353411 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:50.354810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:50.356421 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:50.357330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:50.497044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:50.504621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-67d6b6dc-8169-4b56-b0e4-fd36183e0c6c tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.163281 Nov 11 01:09:50.505181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 524/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:50 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:50.567273 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:50.567896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:50.573880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:50.574350 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:50.575202 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:50.575629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:50.694405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5dc839f7-2a67-4f81-89f5-0b140cf07504 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 28682 microversion: 2.20 time: 14.389958 Nov 11 01:09:50.695895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 503/1027] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:36 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 28682 bytes in 14393 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:50.737889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:50.745664 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d73c2380-508a-493e-a499-14c6b75ffbb6 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.182017 Nov 11 01:09:50.755005 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 525/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:50 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:51.004447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:51.005560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:51.012992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.014316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.015414 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.016082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.179259 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-a1fdb222-e043-4e25-b57c-71285dab857a req-d9c16daa-b8d2-425d-8fc0-d611b9b62942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:51.180775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:51.180775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:09:51.202405 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-a1fdb222-e043-4e25-b57c-71285dab857a req-d9c16daa-b8d2-425d-8fc0-d611b9b62942 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.205966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-a1fdb222-e043-4e25-b57c-71285dab857a req-d9c16daa-b8d2-425d-8fc0-d611b9b62942 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.222843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-a1fdb222-e043-4e25-b57c-71285dab857a req-d9c16daa-b8d2-425d-8fc0-d611b9b62942 service nova] Creating event network-changed:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:09:51.238663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-a1fdb222-e043-4e25-b57c-71285dab857a req-d9c16daa-b8d2-425d-8fc0-d611b9b62942 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063226 Nov 11 01:09:51.240058 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 526/1029] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:51.255036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:51.263186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-38f8d1fc-2435-41e9-86ad-f09c85581587 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.262895 Nov 11 01:09:51.275257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 504/1030] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:50 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:51.522074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:51.522797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:51.529296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.529744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.530519 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.530968 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.677269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:51.686339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-64865658-5131-4b91-9c94-ee8b010d54a5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.168298 Nov 11 01:09:51.686828 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 527/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:51 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:51.707359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:51.708462 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:51.715125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.715580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.716358 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.716793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.762430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:51.763076 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:51.769468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.769923 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.770695 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:51.771157 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:51.900743 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:51.908344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-79c82098-1096-4c49-baab-52015ff0c510 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.149488 Nov 11 01:09:51.909243 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 528/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:51 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:51.912491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4568e853-c618-43c8-a2db-05adb42adf65 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 28682 microversion: 2.20 time: 0.209304 Nov 11 01:09:51.913139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 505/1033] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:51 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 28682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:52.280168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:52.281014 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:52.287087 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.287538 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.288317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.288748 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.421570 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:52.428935 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-197fbc26-ba72-4e27-a2ea-35ccf76dc099 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.152396 Nov 11 01:09:52.429501 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 529/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:52 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:52.703224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:52.703914 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:52.711831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.712415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.713022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.713450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.851019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:52.858109 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c15b907f-7b60-4fa8-b27d-3a45119ea85d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.158929 Nov 11 01:09:52.858661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 506/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:52 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:52.924544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:52.925116 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:52.925538 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:52.926374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:52.932285 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.932675 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.932788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.933125 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.933505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.933932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:52.934040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:52.934364 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:53.064828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:53.072974 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3ba613a7-d6da-4465-8c48-84716ca7ea64 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.151602 Nov 11 01:09:53.073536 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 507/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:52 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:53.095180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-60f03fe1-602a-4768-a9d6-64e60146fad1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 28682 microversion: 2.20 time: 0.174173 Nov 11 01:09:53.095971 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 530/1037] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:52 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 28682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:53.445581 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:53.446318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:53.453540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:53.453988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:53.454782 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:53.455252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:53.585889 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:53.593292 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-254a13d3-edce-4f82-bc6d-2400daf6ff92 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1504 microversion: 2.1 time: 0.151427 Nov 11 01:09:53.593856 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 508/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:53 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:53.876031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:53.876730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:53.884288 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:53.884736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:53.885508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:53.885944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.029038 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:54.038645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bf355c65-ea0c-4a49-9196-0361c6cb7245 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.165429 Nov 11 01:09:54.038645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 531/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:53 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:54.073686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-402b76fe-0b2b-492a-9cc4-36ac67415802 req-c08f9dfd-90e9-4a80-bada-cfad3266c1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916da15a-2905-49a9-84dc-4bccf2f8f4a5", "name": "network-vif-deleted", "tag": "4ad1c4c9-70f2-41c2-823a-a2515ce5751e"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:54.075627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:09:54.075627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:09:54.083422 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-402b76fe-0b2b-492a-9cc4-36ac67415802 req-c08f9dfd-90e9-4a80-bada-cfad3266c1d2 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.083898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-402b76fe-0b2b-492a-9cc4-36ac67415802 req-c08f9dfd-90e9-4a80-bada-cfad3266c1d2 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.091285 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:54.092368 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:54.095417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-402b76fe-0b2b-492a-9cc4-36ac67415802 req-c08f9dfd-90e9-4a80-bada-cfad3266c1d2 service nova] Creating event network-vif-deleted:4ad1c4c9-70f2-41c2-823a-a2515ce5751e for instance 916da15a-2905-49a9-84dc-4bccf2f8f4a5 on hv-cinder-81708 Nov 11 01:09:54.099445 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.099983 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.100432 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-402b76fe-0b2b-492a-9cc4-36ac67415802 req-c08f9dfd-90e9-4a80-bada-cfad3266c1d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030377 Nov 11 01:09:54.101411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 509/1040] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:09:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:09:54.103107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.103638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.109096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:54.110122 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:54.116715 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.117164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.117955 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.118388 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.241074 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:54.249145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8e8ba8d8-4d48-44da-8a72-cba0e682258a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.163291 Nov 11 01:09:54.249754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 532/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:54 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:54.254989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-27b75f9c-1428-42ba-9d46-ed1479260126 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 29614 microversion: 2.20 time: 0.149956 Nov 11 01:09:54.255893 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 510/1042] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:54 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 29614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:54.610271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:54.610887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:54.617944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.618398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.619208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.619649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.648847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:54.649295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:54.649743 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lazy-loading 'fault' on Instance uuid 916da15a-2905-49a9-84dc-4bccf2f8f4a5 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:09:54.688722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4d1564049544579728cc6109d99fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42eb5f73fb374af78bba48a01fee4398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:54.696224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c585f948-67a5-4761-88e7-360b049137ec tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 200 len: 1304 microversion: 2.1 time: 0.089591 Nov 11 01:09:54.696729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 533/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:54 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:55.054405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:55.055129 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:55.061897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.062341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.063148 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.063584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.195798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:55.203199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-22f3cfb8-d3d9-462d-a174-d3a3bb420ca9 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.152931 Nov 11 01:09:55.203768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 511/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:55 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:55.265778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:55.266369 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:55.266727 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:55.267142 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:55.274137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.274393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.274843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.274999 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.275653 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.275765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.276081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.276195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.399504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ed8f02c3-b310-4225-afa6-a79aabfc2423 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 30800 microversion: 2.20 time: 0.137203 Nov 11 01:09:55.400257 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 534/1045] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:55 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 30800 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:55.417596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:55.425236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-34d42f2c-8921-4edb-8ba7-8e831bfcbb3e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.162599 Nov 11 01:09:55.426022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 512/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:55 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:55.714711 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:55.715431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] [instance: 916da15a-2905-49a9-84dc-4bccf2f8f4a5] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:55.722139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.722709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.723609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:55.724041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:55.737672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] HTTP exception thrown: Instance 916da15a-2905-49a9-84dc-4bccf2f8f4a5 could not be found. Nov 11 01:09:55.738778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] Returning 404 to user: Instance 916da15a-2905-49a9-84dc-4bccf2f8f4a5 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:09:55.739686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bab4aa99-00c0-4c03-bff6-8dc6bac65016 tempest-VolumesActionsTest-1269276104 tempest-VolumesActionsTest-1269276104-project] 10.222.0.52 "GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5" status: 404 len: 111 microversion: 2.1 time: 0.029754 Nov 11 01:09:55.740206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 535/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:55 2021] GET /compute/v2.1/servers/916da15a-2905-49a9-84dc-4bccf2f8f4a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:09:56.220113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:56.220910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:56.227977 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:56.228417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:56.229191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:56.229621 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:56.371348 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:56.380416 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-aaabb344-d023-48c1-a65d-8f39f08f671e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.162313 Nov 11 01:09:56.380988 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 513/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:56 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:56.412348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:56.413270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:56.422145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:56.422145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:56.422145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:56.422458 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:56.444157 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:56.444760 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:56.450693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:56.451118 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:56.452092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:56.452516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:56.579561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:56.586711 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e532d0fa-af7b-4905-b5e2-6911936d722c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 31915 microversion: 2.20 time: 0.179254 Nov 11 01:09:56.588659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 536/1049] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:56 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 31915 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:09:56.588821 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5afd5f12-744e-40ae-ab90-b4c39b93396d tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.148910 Nov 11 01:09:56.588821 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 514/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:56 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:57.398230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:57.398969 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:57.405703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:57.406147 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:57.406916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:57.407376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:57.551992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:57.559249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-32c29a65-767b-458e-8ad4-02c99b29db2b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.166018 Nov 11 01:09:57.559795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 537/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:57 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:57.598674 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:09:57.599667 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:57.604456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:57.605061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:57.605887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:57.606345 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:57.607178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:57.607613 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:57.610801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:57.611282 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:57.612075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:57.612487 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:57.744179 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:57.751294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dc3bb59f-b127-4ae0-8743-4dcf741be12f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.150501 Nov 11 01:09:57.751845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 538/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:57 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:58.576516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:58.577182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:58.583967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:58.584401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:58.585172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:58.585601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:58.719001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:58.727546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ad64e54e-d494-4bf5-bea7-762bf3d4fa44 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.154681 Nov 11 01:09:58.728100 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 539/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:58 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:58.768367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:58.768996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:58.775700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:58.776141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:58.776906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:58.777328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:58.904371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:58.911563 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b21db97f-dd81-478f-b8e8-476061ca6751 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.146703 Nov 11 01:09:58.912117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 540/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:58 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:09:59.744704 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:59.745341 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:59.751555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:59.751998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:59.752756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:59.753185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:59.796512 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4a996c79-a92a-44c1-94c5-83e8355e8ce4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 34665 microversion: 2.20 time: 2.201651 Nov 11 01:09:59.797196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 515/1055] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:09:57 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 34665 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:09:59.882120 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:09:59.889526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-863c06f8-95e4-4e82-9a41-ac304545897d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.148561 Nov 11 01:09:59.890091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 541/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:59 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:09:59.928807 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:09:59.929499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:09:59.936328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:59.936776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:09:59.937551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:09:59.937984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:00.077839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:00.085986 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2aea15f2-d2bb-4ae0-81c8-5fec93636a40 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.161807 Nov 11 01:10:00.086547 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 516/1057] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:09:59 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:00.809334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:00.810252 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:00.816511 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:00.816955 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:00.818441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:00.818875 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:00.905310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:00.906008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:00.912218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:00.912666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:00.913443 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:00.913874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:00.943461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9c9294c5-5d1f-4001-8976-8e988bc5b98b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 35383 microversion: 2.20 time: 0.136740 Nov 11 01:10:00.944997 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 542/1058] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:00 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 35383 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:01.062884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:01.071513 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-34aa55d1-1e58-4697-9c82-8a94a672ad39 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.169781 Nov 11 01:10:01.072426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 517/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:00 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:01.103645 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:01.105317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:01.112339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:01.112908 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:01.113822 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:01.114663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:01.295805 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:01.308947 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-05dc2c3a-e84d-4406-b64d-3f829e4dde03 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.209174 Nov 11 01:10:01.310686 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 543/1060] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:01 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:01.923019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-fc46e921-6ea8-4d3e-b066-881c7fc69387 req-d514770c-b21c-4793-b2f2-ab8077e2520b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "name": "network-vif-plugged", "status": "completed", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:01.925218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:01.925218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:10:01.943395 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-fc46e921-6ea8-4d3e-b066-881c7fc69387 req-d514770c-b21c-4793-b2f2-ab8077e2520b service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:01.944203 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-fc46e921-6ea8-4d3e-b066-881c7fc69387 req-d514770c-b21c-4793-b2f2-ab8077e2520b service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:01.956303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:01.958131 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:01.969021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:01.974103 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:01.975291 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:01.978021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:01.980167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-fc46e921-6ea8-4d3e-b066-881c7fc69387 req-d514770c-b21c-4793-b2f2-ab8077e2520b service nova] Creating event network-vif-plugged:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:10:01.993808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-fc46e921-6ea8-4d3e-b066-881c7fc69387 req-d514770c-b21c-4793-b2f2-ab8077e2520b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074552 Nov 11 01:10:01.995438 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 518/1061] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:02.108035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f1c97a6f-38c4-4013-87bf-3118aca5b1ad tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 36202 microversion: 2.20 time: 0.155443 Nov 11 01:10:02.109196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 544/1062] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:01 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 36202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:10:02.332585 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:02.335256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:02.336598 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:02.339351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:02.352572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:02.352994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:02.353786 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:02.354225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:02.356773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:02.357244 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:02.358095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:02.358583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:02.625277 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:02.631691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:02.634666 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-320734db-4119-4382-91e3-26c7d9ef49b7 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.548373 Nov 11 01:10:02.642847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dde7860e-f28d-43cb-9b36-96a55729c35f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.317255 Nov 11 01:10:02.650995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 545/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:02 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:02.651168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 519/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:02 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:03.124755 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:03.126355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:03.136970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:03.137435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:03.138473 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:03.139130 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:03.272182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-75827efc-0109-4123-a93d-ee3a39324b94 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 36995 microversion: 2.20 time: 0.152557 Nov 11 01:10:03.273461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 546/1065] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:03 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 36995 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:03.652339 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:03.652975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:03.659490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:03.660190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:03.661195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:03.661790 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:03.665441 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:03.667422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:03.675987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:03.676594 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:03.678749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:03.679206 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:03.875097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:03.879993 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:03.884603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9d914b72-a0e5-433e-ab98-0477177b99ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1358 microversion: 2.1 time: 0.225199 Nov 11 01:10:03.885426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 547/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:03 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:03.895065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fa536b00-e9e0-48dc-9a41-f14055ae952b tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.245843 Nov 11 01:10:03.896120 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 520/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:03 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:04.283838 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:04.285093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:04.292079 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:04.292604 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:04.293456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:04.293938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:04.440595 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1c41c260-4062-4711-858b-621560694cf0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 37730 microversion: 2.20 time: 0.160288 Nov 11 01:10:04.441596 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 548/1068] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:04 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 37730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:04.901645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:04.903324 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:04.909860 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:04.910627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:04.912935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:04.913620 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:04.914392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:04.915140 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:04.922729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:04.923611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:04.924415 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:04.924854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.152267 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:05.165689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c678fe49-09a8-4717-8f3f-8bc530c784d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1549 microversion: 2.1 time: 0.267668 Nov 11 01:10:05.166275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 521/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:04 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:05.181029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:05.185977 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-07a60d36-40d5-496b-9250-bf3e4c8ce1f0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.276858 Nov 11 01:10:05.186713 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 549/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:04 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:05.188583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:05.189710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:05.199504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.200584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.202009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.202926 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.371331 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:05.379796 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-77371ff3-0dfb-444d-bc0b-21f95059c45a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1549 microversion: 2.1 time: 0.196799 Nov 11 01:10:05.381238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 522/1071] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:05 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:05.396520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:05.400047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:05.400047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:05.401088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:05.402193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Searching by: {'deleted': False, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b'} {{(pid=116016) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 11 01:10:05.412468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.413088 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.414339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.414976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.453782 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:05.454937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:05.463963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.463963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.463963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.463963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.550929 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.multi_cell_list [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 11 01:10:05.576479 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-603e8606-030d-47c2-b55c-f987f0a52806 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 38228 microversion: 2.20 time: 0.125732 Nov 11 01:10:05.580487 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 523/1072] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:05 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 38228 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:05.682801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2cb17b32-3d8e-416e-a5a4-a0b9f3845151 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.290017 Nov 11 01:10:05.683596 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 550/1073] 10.222.0.52 () {58 vars in 1124 bytes} [Thu Nov 11 01:10:05 2021] GET /compute/v2.1/servers => generated 342 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:05.697320 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:05.698024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:05.707255 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.707719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.709749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:05.710840 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:05.878209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:05.886499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8f5e3aff-b8d5-476a-a6f8-0525fb5cb219 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1549 microversion: 2.1 time: 0.194749 Nov 11 01:10:05.893089 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 524/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:05 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:06.229110 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:06.230323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:06.241409 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:06.242386 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:06.243908 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:06.244592 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:06.473346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:06.487592 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bddca166-a361-45f0-b0d6-02a80b0f9f28 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.286455 Nov 11 01:10:06.490647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 551/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:06 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:06.587888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:06.589002 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:06.596553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:06.597000 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:06.597894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:06.598321 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:06.714280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9640e3a4-26f6-4dbd-8a60-0c66b2b09fbd tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 38228 microversion: 2.20 time: 0.129870 Nov 11 01:10:06.715672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 525/1076] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:06 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 38228 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:10:07.507053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:07.507797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:07.514467 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.515265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.516271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.516916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.580814 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2c2c0c5-72d1-4f43-89f2-96a4f381f603"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:07.582604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:07.590117 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.591686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.592721 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.593391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.715004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:07.730684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9754d025-8716-4afb-af8b-a40fabc2f13d tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.227815 Nov 11 01:10:07.743008 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 552/1077] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:07 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:07.747938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:07.749018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:07.757117 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.757567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.758331 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.758925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.890333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f6ad4d98-72fa-40f3-8067-b22b47005f62 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 200 len: 38369 microversion: 2.20 time: 0.145758 Nov 11 01:10:07.891287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 553/1078] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:07 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 38369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:07.903549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:07.904112 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:07.912730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.913174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.913946 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:07.914567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:07.944461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bb4bcd26-e7e4-4312-b6de-e2b5ff7bc640 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/ips" status: 200 len: 152 microversion: 2.20 time: 0.046439 Nov 11 01:10:07.945315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 554/1079] 10.222.0.52 () {60 vars in 1288 bytes} [Thu Nov 11 01:10:07 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:10:07.974902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-11146ce4-b850-406a-b31b-1cf7129fa4c1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400466 Nov 11 01:10:07.976560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 526/1080] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:10:07 2021] POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:08.747596 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:08.748461 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:08.755536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:08.756073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:08.756852 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:08.757275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:08.903296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:08.912154 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-277b2e9d-4213-4d39-8148-5809ea4e87c1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.167320 Nov 11 01:10:08.912564 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 555/1081] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:08 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:09.935896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:09.937294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:09.945879 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:09.946429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:09.947306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:09.947937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.102787 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:10.110671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e9ae867a-d5bf-4abf-b836-b39eb1b345b3 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1569 microversion: 2.1 time: 0.178866 Nov 11 01:10:10.111669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 527/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:09 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:10.128691 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:10.129261 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:10.137196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.137637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.138504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.139009 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.243605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-aede8ac2-bb6c-4150-a973-93feb3f6b784 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "POST /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0/action" status: 202 len: 0 microversion: 2.1 time: 0.117953 Nov 11 01:10:10.244842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 556/1083] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:10 2021] POST /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:10.252500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:10.253332 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:10.261036 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.261646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.262533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.263064 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.339061 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:10.339773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:10.355084 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.356247 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.358583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.359275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.397436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lazy-loading 'flavor' on Instance uuid 2ce8e836-308a-4cdb-8e70-a3d3b431da6d {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:10:10.503050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:10.514202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2272a4fd-2eca-4dd5-a682-1691c356dc3e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1517 microversion: 2.1 time: 0.264881 Nov 11 01:10:10.518386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 528/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:10 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:10.846417 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-21278f2c-3eff-4872-883a-e8ad00e10998 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 202 len: 0 microversion: 2.20 time: 0.511570 Nov 11 01:10:10.852854 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 557/1085] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:10 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:10:10.859423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:10.860727 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:10.870152 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.870597 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:10.871509 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:10.872125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:11.080248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:11.093099 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:11.100158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:11.101819 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-20f3e1d3-62a1-4f55-9423-2d72494f6876 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.247065 Nov 11 01:10:11.114195 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 529/1086] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:10 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:11.536516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:11.538138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:11.544960 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:11.545673 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:11.546715 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:11.547248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:11.693089 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:11.701474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fb9a3db1-d98d-47fa-a2f1-9a376afe1e06 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1519 microversion: 2.1 time: 0.169621 Nov 11 01:10:11.702319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 558/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:11 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:12.121681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:12.123163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:12.129729 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.130718 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.131902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.132356 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.273915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:12.282312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:12.283925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:12.285094 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-56c9581e-775f-47c4-a262-c0baa7650190 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.167906 Nov 11 01:10:12.285652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 530/1088] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:12 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:12.720949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:12.721688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:12.728574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.729024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.729813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.730250 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.830622 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:12.832063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:12.840524 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.841213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.842338 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.842933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.877577 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:12.881538 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-84ac9ace-0cf3-4b3b-b052-c001df654b17 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056765 Nov 11 01:10:12.882155 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 531/1089] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:10:12 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:12.896034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ac0293c2-73bb-44bf-9c91-2017f7e346aa tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1519 microversion: 2.1 time: 0.178684 Nov 11 01:10:12.896818 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 559/1090] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:12 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:12.952153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:12.952644 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:12.959007 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.959691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.960654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:12.961246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:12.990827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:10:13.077478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-08b5945a-5ede-4ee1-a06a-c2ea6b13849a tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 204 len: 0 microversion: 2.1 time: 0.128479 Nov 11 01:10:13.081999 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 532/1091] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:10:12 2021] DELETE /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:10:13.090864 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:13.091672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:13.097762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.098520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.099546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.100267 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.237799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:13.246771 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-64644f25-7abe-4780-be42-39ba7d028152 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1673 microversion: 2.1 time: 0.159621 Nov 11 01:10:13.250992 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 560/1092] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:13 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:13.305525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:13.306418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:13.313252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.313915 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.314705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.315217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.459128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:13.467834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:13.469333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:13.470498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a3b632fd-6d1c-4daf-8681-03735e80fe09 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.170123 Nov 11 01:10:13.481132 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 533/1093] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:13 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:13.914216 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-9d1ae440-293d-4ae9-b271-2e5b4b6c1a06 req-d3bd59c0-08d1-4fb1-8e93-5a4a35ef91bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "name": "network-vif-unplugged", "status": "completed", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:13.915901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:13.915901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:13.921840 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:13.922447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:13.930887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.931399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.932194 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.932628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.937780 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-9d1ae440-293d-4ae9-b271-2e5b4b6c1a06 req-d3bd59c0-08d1-4fb1-8e93-5a4a35ef91bc service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:13.938204 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-9d1ae440-293d-4ae9-b271-2e5b4b6c1a06 req-d3bd59c0-08d1-4fb1-8e93-5a4a35ef91bc service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:13.998010 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.compute.server_external_events [req-9d1ae440-293d-4ae9-b271-2e5b4b6c1a06 req-d3bd59c0-08d1-4fb1-8e93-5a4a35ef91bc service nova] Unable to find a host for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0. Dropping event network-vif-unplugged {{(pid=116016) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 11 01:10:13.998659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-9d1ae440-293d-4ae9-b271-2e5b4b6c1a06 req-d3bd59c0-08d1-4fb1-8e93-5a4a35ef91bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.092451 Nov 11 01:10:14.000389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 561/1094] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:13 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 11 01:10:14.135337 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:14.142859 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b4b969f2-1c96-4dc9-a889-d05a46a1d758 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1519 microversion: 2.1 time: 0.233644 Nov 11 01:10:14.148021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 534/1095] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:13 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:14.264481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:14.265430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:14.271724 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:14.272159 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:14.273102 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:14.273528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:14.408954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:14.416689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-76ef6d71-932b-49f3-815b-2db17c7c22d9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1673 microversion: 2.1 time: 0.155800 Nov 11 01:10:14.417809 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 562/1096] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:14 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:14.488712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:14.490975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:14.497118 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:14.497767 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:14.498749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:14.499364 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:14.653106 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:14.657368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:14.658855 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:14.660056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d9acdedb-4984-480d-9220-8f4e28ac8f97 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.175211 Nov 11 01:10:14.660613 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 535/1097] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:14 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:15.160572 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:15.162810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:15.170668 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.171506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.172699 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.173376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.326989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:15.336416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1deeba5a-7237-470c-bd38-703a6c5c80f1 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1519 microversion: 2.1 time: 0.179766 Nov 11 01:10:15.337082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 563/1098] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:15 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:15.437125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:15.438106 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:15.447064 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.447858 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.448905 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.449570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.558174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:15.568764 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9491ead7-8afa-49cc-ad83-fd9fa9d3b6e7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1606 microversion: 2.1 time: 0.136397 Nov 11 01:10:15.569342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 536/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:15 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1606 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:15.681270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:15.682818 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:15.693837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.694576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.700358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.701028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.912589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:15.913205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:15.923230 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.923664 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.924485 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:15.924932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:15.956485 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:15.975620 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:15.977594 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:15.979382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-72984e95-19b9-4def-84fa-81e481c4a686 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.302945 Nov 11 01:10:15.980991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 564/1100] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:15 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:16.127555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:16.138571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5efbc34a-0605-44f9-bca6-f0a3530c59ba tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1595 microversion: 2.1 time: 0.230211 Nov 11 01:10:16.142600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 537/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:15 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1595 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:16.352429 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-5aee8b8d-c6c8-40ff-92dc-257a8f51cfba req-0e4815b5-2808-4ffd-bf4a-655d24aa5155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8", "name": "network-vif-deleted", "tag": "7957db06-9b36-48fb-91f5-537bca5d85c5"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:16.354096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:16.354096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:16.356250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:16.357120 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:16.365826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:16.369904 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:16.372899 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:16.373526 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:16.384923 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5aee8b8d-c6c8-40ff-92dc-257a8f51cfba req-0e4815b5-2808-4ffd-bf4a-655d24aa5155 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:16.385367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5aee8b8d-c6c8-40ff-92dc-257a8f51cfba req-0e4815b5-2808-4ffd-bf4a-655d24aa5155 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:16.424501 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-5aee8b8d-c6c8-40ff-92dc-257a8f51cfba req-0e4815b5-2808-4ffd-bf4a-655d24aa5155 service nova] Creating event network-vif-deleted:7957db06-9b36-48fb-91f5-537bca5d85c5 for instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 on hv-cinder-81708 Nov 11 01:10:16.439142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-5aee8b8d-c6c8-40ff-92dc-257a8f51cfba req-0e4815b5-2808-4ffd-bf4a-655d24aa5155 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110229 Nov 11 01:10:16.444499 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 565/1102] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:10:16.586333 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:16.586966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:16.598644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:16.599559 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:16.601035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:16.601700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:16.683185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:16.689682 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:16.690156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lazy-loading 'fault' on Instance uuid 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:10:16.780980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:16.789938 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c332b575-4f92-4fca-92be-57fecd2927a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 200 len: 1327 microversion: 2.1 time: 0.207758 Nov 11 01:10:16.793956 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 566/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:16 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 1327 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:16.999719 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:17.000720 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:17.009505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:17.012728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:17.013944 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:17.014544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:17.177534 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:17.195333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c6a4bb6d-e040-489c-95c8-5569ca55c6ce tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1519 microversion: 2.1 time: 0.844436 Nov 11 01:10:17.196851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 538/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:16 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1519 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:17.381265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:17.393509 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:17.395571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:17.396740 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8878a9e7-c6d9-4f3e-b3b1-35ab7496a62e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.401029 Nov 11 01:10:17.412076 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 567/1105] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:16 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:17.810777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:17.811569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:17.826533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:17.827007 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:17.827818 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:17.828248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:17.858228 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] HTTP exception thrown: Instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 could not be found. Nov 11 01:10:17.859167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Returning 404 to user: Instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:10:17.860912 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-49df09a8-6c42-4ae2-9d22-ed60a94e7c83 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 404 len: 111 microversion: 2.1 time: 0.054176 Nov 11 01:10:17.862264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 539/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:17 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:10:17.870707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1c948f45-7fb8-4645-9ae3-d9463f4f0cf4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '.version_select at 0x7fd36821bdc0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:17.899092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1c948f45-7fb8-4645-9ae3-d9463f4f0cf4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-184137629" status: 202 len: 0 microversion: 2.1 time: 0.031811 Nov 11 01:10:17.920008 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 568/1107] 10.222.0.52 () {58 vars in 1217 bytes} [Thu Nov 11 01:10:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-184137629 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:18.224951 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:18.226959 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:18.235545 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:18.236412 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:18.237617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:18.238368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:18.431032 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:18.433069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:18.458168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:18.463494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:18.467230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:18.469584 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:18.584088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:18.589192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cee3aa6b-cb64-428b-82ab-4afddd8013ea tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.376916 Nov 11 01:10:18.615756 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 540/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:18 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:18.814127 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:18.828637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:18.833829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:18.837149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-04e6370a-5235-4b84-aad0-20057da0e44a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.422720 Nov 11 01:10:18.840837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 569/1109] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:18 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:19.084307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9b25a70d-59ba-4abd-9cf5-48d2bd8ea358 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: .version_select at 0x7fd36405b160>, body: {"keypair": {"name": "tempest-keypair-1507753466"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:19.103881 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-9b25a70d-59ba-4abd-9cf5-48d2bd8ea358 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:10:19.108700 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-9b25a70d-59ba-4abd-9cf5-48d2bd8ea358 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for user fe12fd7b58fb46a79f92729e3ef7a105 and project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:10:19.304613 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-9b25a70d-59ba-4abd-9cf5-48d2bd8ea358 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:10:19.308247 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-9b25a70d-59ba-4abd-9cf5-48d2bd8ea358 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for user fe12fd7b58fb46a79f92729e3ef7a105 and project d65821f142fe445b8388094f872c5457. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:10:19.321094 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9b25a70d-59ba-4abd-9cf5-48d2bd8ea358 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.241911 Nov 11 01:10:19.321871 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 541/1110] 10.222.0.52 () {60 vars in 1157 bytes} [Thu Nov 11 01:10:19 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:19.623253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:19.623874 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:19.632207 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:19.632886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:19.633901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:19.634324 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:19.734589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-8195da68-b800-46de-ba7b-d79889ccc9e8 req-61e63e23-f9f1-4a65-937a-f8da0cea8384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:19.736172 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:19.736172 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:10:19.755763 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-8195da68-b800-46de-ba7b-d79889ccc9e8 req-61e63e23-f9f1-4a65-937a-f8da0cea8384 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:19.756771 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-8195da68-b800-46de-ba7b-d79889ccc9e8 req-61e63e23-f9f1-4a65-937a-f8da0cea8384 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:19.773499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-8195da68-b800-46de-ba7b-d79889ccc9e8 req-61e63e23-f9f1-4a65-937a-f8da0cea8384 service nova] Creating event network-changed:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:10:19.784559 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-8195da68-b800-46de-ba7b-d79889ccc9e8 req-61e63e23-f9f1-4a65-937a-f8da0cea8384 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052308 Nov 11 01:10:19.786300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 542/1111] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:10:19.858328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:19.859591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:19.873772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:19.874749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:19.875880 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:19.876873 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:20.124290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:20.132981 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-95d9d36d-730a-472b-9357-5e61cbdfd6a2 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.514203 Nov 11 01:10:20.142670 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 570/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:19 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:20.177502 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:20.193976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:20.196780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:20.197992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a2b56a0b-970b-4d32-931a-5e1187a7c36c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.345381 Nov 11 01:10:20.198528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 543/1113] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:19 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:21.158863 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:21.161256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:21.170172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:21.170895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:21.172082 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:21.173092 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:21.216638 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:21.218018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:21.228283 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:21.233835 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:21.234048 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:21.234884 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:21.498324 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:21.506067 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:21.506233 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ae71746e-efd4-462e-9832-1a154a125070 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.359715 Nov 11 01:10:21.506730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 571/1114] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:21 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:21.511464 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1638736846", "imageRef": "15b9cf99-f11a-4f8d-9868-5a1f8aac81c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0201e78f-31b0-4780-85e5-2d0c4a5203a2"}], "security_groups": [{"name": "tempest-securitygroup--1583811581"}], "key_name": "tempest-keypair-1507753466", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:21.520420 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:21.521942 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:21.523238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3c32addb-2f57-4491-bcd9-587666dc982f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.311205 Nov 11 01:10:21.523791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 544/1115] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:21 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:21.528035 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-868662320"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:21.528565 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:21.535453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:21.536456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:21.537244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:21.537675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:21.646402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] validate_networks() for [('0201e78f-31b0-4780-85e5-2d0c4a5203a2', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:10:21.776503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.network.security_group_api [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Adding security group e539e8a8-1221-4448-baf2-b28c3821e1a7 to port c2076f3e-6040-4813-a257-8804dcab051f Nov 11 01:10:22.526297 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:10:22.526810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:10:22.527221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:10:22.528254 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:10:22.528986 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:10:22.538574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.539468 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.540296 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.540736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.566203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for project d65821f142fe445b8388094f872c5457. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:10:22.571003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Getting quotas for user fe12fd7b58fb46a79f92729e3ef7a105 and project d65821f142fe445b8388094f872c5457. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:10:22.585609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e6375b2a-7386-4e51-96da-89ce1043cd67 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/action" status: 202 len: 0 microversion: 2.1 time: 1.060608 Nov 11 01:10:22.586344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 545/1116] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:21 2021] POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/action => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:10:22.592851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:22.593461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:22.604525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.604980 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.607825 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:10:22.609423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.610024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.610756 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15b9cf99-f11a-4f8d-9868-5a1f8aac81c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:10:22.700557 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4d141649-8b62-4069-ae2e-b58a7e676700 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.192721 Nov 11 01:10:22.701204 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 572/1117] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:10:21 2021] POST /compute/v2.1/servers => generated 402 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:10:22.719142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:22.719993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:22.748734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.749182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.750865 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.760087 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.886575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:22.900975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e4857a7e-7f3f-4493-a48d-47d837051430 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.313355 Nov 11 01:10:22.904178 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 546/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:22 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:22.917043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:22.918050 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:22.932742 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.933437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.934825 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:22.935495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:22.998670 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:23.017267 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:23.022827 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:23.024205 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a5ec1381-8677-438f-8a41-4fda06189c1d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.321921 Nov 11 01:10:23.034930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 573/1119] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:22 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:23.034930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-a57151c0-b846-4013-bb30-2421f00b0b61 req-0cdc3d4b-18c9-414c-9e7e-cdb499a83a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:23.034930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:23.034930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:23.042017 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-a57151c0-b846-4013-bb30-2421f00b0b61 req-0cdc3d4b-18c9-414c-9e7e-cdb499a83a64 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:23.042466 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-a57151c0-b846-4013-bb30-2421f00b0b61 req-0cdc3d4b-18c9-414c-9e7e-cdb499a83a64 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:23.056056 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-a57151c0-b846-4013-bb30-2421f00b0b61 req-0cdc3d4b-18c9-414c-9e7e-cdb499a83a64 service nova] Creating event network-changed:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:10:23.062581 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-a57151c0-b846-4013-bb30-2421f00b0b61 req-0cdc3d4b-18c9-414c-9e7e-cdb499a83a64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033760 Nov 11 01:10:23.063600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 574/1120] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:23.071930 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bc5211d9-c9c9-4d0a-a41f-6e9c54c4242c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:23.082847 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bc5211d9-c9c9-4d0a-a41f-6e9c54c4242c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:23.208124 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-bc5211d9-c9c9-4d0a-a41f-6e9c54c4242c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:23.218496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bc5211d9-c9c9-4d0a-a41f-6e9c54c4242c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1238 microversion: 2.1 time: 0.153033 Nov 11 01:10:23.219817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 575/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:23 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1238 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:23.235711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:23.244131 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fb0524f9-a41d-4bb8-bb3f-eb2d586a7c47 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1760 microversion: 2.1 time: 0.337960 Nov 11 01:10:23.255268 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 547/1122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:22 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1760 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:23.920156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:23.922566 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:23.934894 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:23.935548 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:23.936403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:23.936835 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:24.042008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:24.043304 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:24.049182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:24.049640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:24.050422 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:24.050857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:24.077677 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:24.090269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c262e2f6-6078-428c-a3e0-986a7a68b6ed tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.175426 Nov 11 01:10:24.091601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 576/1123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:23 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:24.204128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:24.212927 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:24.214693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:24.215854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c9565b68-f082-4388-a509-d3d30243e0fe tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.177769 Nov 11 01:10:24.216853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 548/1124] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:24 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:24.235999 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:24.236644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:24.244317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:24.244760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:24.245536 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:24.246231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:24.318563 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:24.328131 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8c9fdf71-f635-4adb-a0e8-91d8e7716a0d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1298 microversion: 2.1 time: 0.095540 Nov 11 01:10:24.332412 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 577/1125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:24 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:25.107149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:25.107887 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:25.115238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.115991 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.116863 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.117365 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.239278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:25.240665 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:25.249406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.250131 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.251193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.251842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.264305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:25.272996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a6bbc649-ca35-438e-869c-9b92e921de72 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.169608 Nov 11 01:10:25.273967 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 549/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:25 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:25.345518 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:25.346809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:25.354011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.354458 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.355265 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.355694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.392194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:25.402043 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:25.404522 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:25.406063 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e9eb338c-951c-4d3e-98b8-4a5fd9c2e12b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.173271 Nov 11 01:10:25.407159 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 578/1127] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:25 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:25.507866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:25.515553 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8529b3e3-6ca3-4e85-9224-9fb547c16cbe tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.173602 Nov 11 01:10:25.516137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 550/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:25 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:25.684551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-ee646234-e3f6-47b6-8e90-d7223c3298da req-d9c4408d-3383-4dc1-a829-d2a994e7e54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a93927e-164e-4860-bf84-1abd71f70a7e", "tag": "44f556ed-442c-489b-8797-5d8ba69793e5"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:25.694599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:25.694599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:25.712954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-ee646234-e3f6-47b6-8e90-d7223c3298da req-d9c4408d-3383-4dc1-a829-d2a994e7e54f service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:25.712954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-ee646234-e3f6-47b6-8e90-d7223c3298da req-d9c4408d-3383-4dc1-a829-d2a994e7e54f service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:25.721806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-ee646234-e3f6-47b6-8e90-d7223c3298da req-d9c4408d-3383-4dc1-a829-d2a994e7e54f service nova] Creating event network-changed:44f556ed-442c-489b-8797-5d8ba69793e5 for instance 1a93927e-164e-4860-bf84-1abd71f70a7e on hv-cinder-81708 Nov 11 01:10:25.727389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-ee646234-e3f6-47b6-8e90-d7223c3298da req-d9c4408d-3383-4dc1-a829-d2a994e7e54f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059845 Nov 11 01:10:25.727975 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 579/1129] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:26.290659 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:26.291314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:26.297572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:26.298011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:26.298786 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:26.299250 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:26.425734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:26.426738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:26.433302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:26.433754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:26.434712 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:26.435352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:26.435853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:26.443657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f2e86a46-7d88-4c7b-9f2d-e9eecf57996f tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.156584 Nov 11 01:10:26.444357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 551/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:26 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:26.534059 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:26.534754 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:26.541798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:26.542298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:26.543205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:26.543645 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:26.576618 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:26.586481 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:26.588458 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:26.590022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fa656b67-adbd-4d5b-a501-0152e4da5e6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.168684 Nov 11 01:10:26.590586 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 580/1131] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:26 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:26.685015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:26.693524 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9c2dd300-99c3-47c0-8b10-451a8855cb94 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.163790 Nov 11 01:10:26.694115 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 552/1132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:26 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:27.461069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:27.461692 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:27.468317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:27.468761 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:27.469522 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:27.469949 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:27.603725 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:27.607777 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:27.608383 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:27.610969 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-24925376-04c0-4c76-827b-eee7893ad2e5 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.154240 Nov 11 01:10:27.611526 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 581/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:27 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:27.614869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:27.615361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:27.616182 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:27.616620 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:27.710530 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:27.711242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:27.717914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:27.718460 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:27.719512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:27.720013 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:27.746183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:27.754723 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:27.756303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:27.757478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0168346b-10d4-4304-b645-43573044e61c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1744 microversion: 2.20 time: 0.153341 Nov 11 01:10:27.758040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 553/1134] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:27 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:27.850318 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:27.857503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-11caf299-9410-45f7-88d8-41efc45d30f7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.151827 Nov 11 01:10:27.858004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 582/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:27 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:28.632285 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:28.632747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:28.639585 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:28.640366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:28.641609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:28.642207 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:28.777786 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:28.780147 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:28.787952 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:28.790018 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:28.790879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:28.791401 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:28.806569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:28.814649 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-304f795f-530a-4248-a065-d0442713ba9e tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.191204 Nov 11 01:10:28.815264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 554/1136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:28 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:28.876454 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:28.877226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:28.884071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:28.884714 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:28.885722 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:28.886227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:28.993354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:29.003503 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:29.012211 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:29.013741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-559edf42-7fd6-4ea2-aafb-d026962c0720 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.240746 Nov 11 01:10:29.014508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 583/1137] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:28 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:29.067829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:29.075929 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dc085cd1-9a22-48af-aab2-173e5eb0ab56 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.203327 Nov 11 01:10:29.076488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 555/1138] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:28 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:29.831946 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:29.832796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:29.842482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:29.842929 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:29.843738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:29.844166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:30.034571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:30.037411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:30.038681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:30.043345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dc1c2980-cae8-4fb3-9190-569a498875ff tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.215415 Nov 11 01:10:30.044245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 584/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:29 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:30.058408 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:30.058969 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:30.059851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:30.060353 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:30.093761 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:30.094543 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:30.107783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:30.108323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:30.109197 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:30.109696 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:30.402550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:30.418313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:30.422661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:30.424888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-61f930ba-409d-469e-bd5d-b681b687067a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.392334 Nov 11 01:10:30.438716 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 556/1140] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:30 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:30.454185 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-ac6d00ee-8eb2-48cc-b6ad-3e87526c25da req-495f8b6e-5271-4514-8d03-fa1680009d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "name": "network-vif-plugged", "status": "completed", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:30.459604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:30.459604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:10:30.482244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-ac6d00ee-8eb2-48cc-b6ad-3e87526c25da req-495f8b6e-5271-4514-8d03-fa1680009d0c service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:30.484341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-ac6d00ee-8eb2-48cc-b6ad-3e87526c25da req-495f8b6e-5271-4514-8d03-fa1680009d0c service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:30.515508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:30.523729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-defd34a9-77a0-4c49-8afa-998b53a00ec9 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.433894 Nov 11 01:10:30.525583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-ac6d00ee-8eb2-48cc-b6ad-3e87526c25da req-495f8b6e-5271-4514-8d03-fa1680009d0c service nova] Creating event network-vif-plugged:e56a395c-77ef-4622-a62e-fedb27621bdb for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 on hv-cinder-81708 Nov 11 01:10:30.526314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 585/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:30 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:30.542544 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-ac6d00ee-8eb2-48cc-b6ad-3e87526c25da req-495f8b6e-5271-4514-8d03-fa1680009d0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102118 Nov 11 01:10:30.546418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 557/1142] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:31.073567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:31.073567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:31.073567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:31.073567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:31.074219 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:31.074561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:31.257647 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:31.267396 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ab7ccaf3-fecc-40c2-bea5-b35062d1d190 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.210072 Nov 11 01:10:31.268694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 586/1143] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:31 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:31.447277 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:31.448085 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:31.454720 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:31.455266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:31.456114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:31.456618 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:31.541840 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:31.543114 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:31.558044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:31.558918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:31.559979 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:31.564741 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:31.620625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:31.634503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:31.637233 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:31.638805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0b474dc2-b9d0-4f27-a5d9-0f2b6c367ab5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.196381 Nov 11 01:10:31.656517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 558/1144] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:31 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:31.751294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:31.760589 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fcc17fc6-abf6-4273-8816-f68da3e65788 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.222474 Nov 11 01:10:31.761254 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 587/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:31 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:32.289540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:32.290542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:32.296875 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.297436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.298351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.298874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.488022 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:32.522977 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-97c88ba0-122b-4c21-b5e0-415bc00aaf29 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1575 microversion: 2.1 time: 0.236981 Nov 11 01:10:32.531409 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 559/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:32 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:32.571021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-41624b4f-8b73-4267-b958-75de48c0aaea req-55b7df7f-3b25-4b00-b703-f540bf4d0888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "name": "network-vif-plugged", "status": "completed", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:32.576635 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:32.576635 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:32.590660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-41624b4f-8b73-4267-b958-75de48c0aaea req-55b7df7f-3b25-4b00-b703-f540bf4d0888 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.591271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-41624b4f-8b73-4267-b958-75de48c0aaea req-55b7df7f-3b25-4b00-b703-f540bf4d0888 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.610311 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-41624b4f-8b73-4267-b958-75de48c0aaea req-55b7df7f-3b25-4b00-b703-f540bf4d0888 service nova] Creating event network-vif-plugged:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:10:32.624728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-41624b4f-8b73-4267-b958-75de48c0aaea req-55b7df7f-3b25-4b00-b703-f540bf4d0888 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064271 Nov 11 01:10:32.625591 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 588/1147] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:32.657426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:32.658162 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:32.664744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.665192 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.665973 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.666677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.779630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:32.780393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:32.796160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.797381 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.798426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:32.799457 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:32.857921 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:32.868153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:32.869958 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:32.871159 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7a371e4f-41d9-414a-86af-9613a8ea1006 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.217511 Nov 11 01:10:32.871709 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 560/1148] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:32 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:32.986050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:32.997095 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-76bfd6a1-1546-46f4-8398-a3b151db5d09 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.221938 Nov 11 01:10:32.997657 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 589/1149] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:32 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:33.548224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:33.548908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:33.559952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:33.561708 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:33.562657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:33.563582 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:33.736655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:33.747359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d3dd73a6-8c52-42af-8d0c-a77a0254f326 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1562 microversion: 2.1 time: 0.202698 Nov 11 01:10:33.748109 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 561/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:33 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1562 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:33.892395 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:33.893148 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:33.901130 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:33.902932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:33.907874 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:33.908319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:34.013909 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:34.014374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:34.023110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:34.026918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:34.027864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:34.028342 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:34.161523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:34.170185 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:34.177126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:34.178583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f7164de7-e8bc-47c3-8570-748f21f9e17c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.290101 Nov 11 01:10:34.180916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 590/1151] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:33 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:34.240300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:34.259291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-eebf63f5-a3bf-40e4-b927-320123adb5eb tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.249241 Nov 11 01:10:34.260105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 562/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:34 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:34.640789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-10d20777-bd36-40a1-863f-36d7ff419f03 req-611620a1-28b6-46e4-8883-6f4349581acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a93927e-164e-4860-bf84-1abd71f70a7e", "name": "network-vif-plugged", "status": "completed", "tag": "44f556ed-442c-489b-8797-5d8ba69793e5"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:34.642330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:34.642330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:34.651925 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-10d20777-bd36-40a1-863f-36d7ff419f03 req-611620a1-28b6-46e4-8883-6f4349581acd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:34.652430 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-10d20777-bd36-40a1-863f-36d7ff419f03 req-611620a1-28b6-46e4-8883-6f4349581acd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:34.664137 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-10d20777-bd36-40a1-863f-36d7ff419f03 req-611620a1-28b6-46e4-8883-6f4349581acd service nova] Creating event network-vif-plugged:44f556ed-442c-489b-8797-5d8ba69793e5 for instance 1a93927e-164e-4860-bf84-1abd71f70a7e on hv-cinder-81708 Nov 11 01:10:34.671928 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-10d20777-bd36-40a1-863f-36d7ff419f03 req-611620a1-28b6-46e4-8883-6f4349581acd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034654 Nov 11 01:10:34.672713 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 591/1153] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:35.202103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:35.202786 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:35.209899 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:35.211282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:35.212312 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:35.213497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:35.277021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:35.278023 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:35.291694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:35.292460 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:35.293515 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:35.294304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:35.420401 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:35.430461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:35.433376 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:35.434967 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c3ef0af3-37c4-4223-93db-8e771bad7c74 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.239751 Nov 11 01:10:35.435761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 563/1154] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:35 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:35.520914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:35.537310 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-819993f0-35fb-49ca-ae44-62db7b064566 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1364 microversion: 2.1 time: 0.264669 Nov 11 01:10:35.537893 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 592/1155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:35 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:10:36.453728 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:36.454434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:36.466222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:36.466779 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:36.467690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:36.469252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:36.558275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:36.559822 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:36.567567 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:36.568290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:36.569258 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:36.569853 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:36.713076 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:36.726643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:36.729173 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:36.730668 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-390e0ec0-3ccb-4aa7-b52e-85df97ba5c6b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.280890 Nov 11 01:10:36.731921 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 564/1156] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:36 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:36.787327 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:36.796425 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-02152883-9436-4708-ab7c-e456959c3dce tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1551 microversion: 2.1 time: 0.241765 Nov 11 01:10:36.808597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 593/1157] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:10:36 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1551 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:36.815225 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:36.815865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:36.826667 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:36.827157 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:36.827959 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:36.828407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:36.948932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-20686ce2-78e5-47ca-8afa-58d09a76a7ef tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138271 Nov 11 01:10:36.949533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 565/1158] 10.222.0.52 () {58 vars in 1274 bytes} [Thu Nov 11 01:10:36 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:37.756822 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:37.758181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:37.764490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:37.769014 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:37.771496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:37.772164 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:37.968236 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:37.979871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:37.982480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:37.984091 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-394a599c-016e-4555-90fa-525e72281a29 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.231483 Nov 11 01:10:37.984873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 594/1159] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:37 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:38.094242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:38.095650 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:38.099495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-b5fcddf0-04a3-4d4a-8796-28ed7d34a93f req-bcca7d82-38e0-4a3c-a23d-4ef6ab641969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a93927e-164e-4860-bf84-1abd71f70a7e", "tag": "44f556ed-442c-489b-8797-5d8ba69793e5"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:38.103700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:38.103700 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:38.104300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:38.105584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:38.106661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:38.107279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:38.113839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-b5fcddf0-04a3-4d4a-8796-28ed7d34a93f req-bcca7d82-38e0-4a3c-a23d-4ef6ab641969 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:38.114454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-b5fcddf0-04a3-4d4a-8796-28ed7d34a93f req-bcca7d82-38e0-4a3c-a23d-4ef6ab641969 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:38.141264 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-b5fcddf0-04a3-4d4a-8796-28ed7d34a93f req-bcca7d82-38e0-4a3c-a23d-4ef6ab641969 service nova] Creating event network-changed:44f556ed-442c-489b-8797-5d8ba69793e5 for instance 1a93927e-164e-4860-bf84-1abd71f70a7e on hv-cinder-81708 Nov 11 01:10:38.161869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-b5fcddf0-04a3-4d4a-8796-28ed7d34a93f req-bcca7d82-38e0-4a3c-a23d-4ef6ab641969 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062430 Nov 11 01:10:38.162533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 595/1160] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:38.261864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-465463e2-e973-4c3f-911c-0ecf9e556573 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 0.171821 Nov 11 01:10:38.262657 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 566/1161] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:38 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:39.004848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:39.006194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:39.013512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:39.013962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:39.020388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:39.020388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:39.205528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:39.217075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:39.218896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:39.220508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b4b68c8c-e972-44fe-9918-4be272436463 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.219664 Nov 11 01:10:39.221574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 596/1162] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:38 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:39.285363 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:39.291122 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:39.298663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:39.299379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:39.309535 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:39.310056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:40.238814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:40.239379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:40.245555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:40.245999 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:40.246768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:40.247230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:40.377325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:40.385580 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:40.387098 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:40.388245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ab066b81-0c36-4288-bf9b-6e23fad3e60d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.153208 Nov 11 01:10:40.388828 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 597/1163] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:40 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:41.411653 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:41.412440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:41.421355 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:41.423313 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:41.424238 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:41.424801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:41.424933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-00cfeb18-3df4-460b-b6bd-5e3d9bb89fea tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 2.150903 Nov 11 01:10:41.428467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 567/1164] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:39 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:41.564400 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:41.573163 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:41.575027 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:41.576422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-89c71dad-88f0-453b-8a3f-1e7b53bc380e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1739 microversion: 2.20 time: 0.172816 Nov 11 01:10:41.577172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 598/1165] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:41 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:42.436441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:42.437449 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:42.445536 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:42.446139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:42.447252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:42.447769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:42.548624 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e1755269-1acf-4367-965a-353671a9a23d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 0.116194 Nov 11 01:10:42.552373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 568/1166] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:42 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:42.596169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:42.596773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:42.604207 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:42.604585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:42.605363 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:42.605818 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:42.740726 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:42.749277 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:42.750903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:42.752259 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d1303cbe-bde0-425a-b8f7-4a01911884df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.159879 Nov 11 01:10:42.752817 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 599/1167] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:42 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:43.559872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:43.560918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:43.568866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:43.569307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:43.570081 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:43.570504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:43.770493 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:43.771132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:43.777407 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:43.777858 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:43.778633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:43.779104 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:43.912387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:43.920044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:43.921540 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:43.922690 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c4b26735-e6ae-4dfd-9809-6c3fc4f2e0e9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.156146 Nov 11 01:10:43.923278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 600/1168] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:43 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:44.941012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:44.941698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:44.948663 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:44.949111 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:44.949880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:44.950314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:45.077452 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:45.085113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:45.086609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:45.087801 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5e4684b8-e75b-408d-8e40-ae3a7b80a8d9 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.150535 Nov 11 01:10:45.088354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 601/1169] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:44 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:45.680457 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bd090b81-b86e-46cf-bf9a-ff9936c4ef0b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 2.124292 Nov 11 01:10:45.681375 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 569/1170] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:43 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:46.073633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-d9ad84a8-c76a-4461-8592-07ccf4236fdc req-375ef43c-96b2-425e-bf52-2e2d281a91a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "name": "network-vif-unplugged", "status": "completed", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:46.075161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:10:46.075161 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:10:46.083235 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d9ad84a8-c76a-4461-8592-07ccf4236fdc req-375ef43c-96b2-425e-bf52-2e2d281a91a8 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:46.084247 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d9ad84a8-c76a-4461-8592-07ccf4236fdc req-375ef43c-96b2-425e-bf52-2e2d281a91a8 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:46.096512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-d9ad84a8-c76a-4461-8592-07ccf4236fdc req-375ef43c-96b2-425e-bf52-2e2d281a91a8 service nova] Creating event network-vif-unplugged:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:10:46.102097 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-d9ad84a8-c76a-4461-8592-07ccf4236fdc req-375ef43c-96b2-425e-bf52-2e2d281a91a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032043 Nov 11 01:10:46.102906 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 602/1171] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:10:46.106542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:46.107276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:46.115208 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:46.115655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:46.116439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:46.116876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:46.253020 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:46.261216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:46.262697 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:46.263868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3fc57dfc-0ad2-4bbd-a413-a22c1582c87b tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.161548 Nov 11 01:10:46.264419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 570/1172] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:46 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:46.693337 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:46.694344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:46.702236 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:46.702868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:46.703972 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:46.704631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:46.817412 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7f01fbef-83d5-48f6-becd-2d9ea42f5bf8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 0.128512 Nov 11 01:10:46.818034 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 603/1173] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:46 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:47.282202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:47.282806 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:47.293055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:47.293517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:47.294313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:47.294751 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:47.430310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:47.437966 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:47.439507 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:47.440665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e7f52b6a-a9e3-4250-990b-f6a5e784c3be tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.162239 Nov 11 01:10:47.441231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 571/1174] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:47 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:47.828796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:47.829924 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:47.837474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:47.837916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:47.838678 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:47.839145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:48.457665 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:48.458278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:48.464833 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:48.465284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:48.466062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:48.466508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:48.596680 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:48.604788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:48.606303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:48.607495 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c1c9d20f-8381-46c4-9f6e-a39989fd8555 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.153665 Nov 11 01:10:48.608055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 572/1175] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:48 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:49.625259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:49.625894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:49.633184 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:49.633626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:49.634398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:49.634828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:49.767227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:49.775213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:49.776703 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:49.777852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ac78870a-cf1f-4340-bc66-fd3dc7426c7a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.156256 Nov 11 01:10:49.778413 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 573/1176] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:49 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:50.008273 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-54446bdc-def0-462f-95ac-1065acca8b5b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 2.183430 Nov 11 01:10:50.009553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 604/1177] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:47 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:50.796030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:50.796636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:50.803361 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:50.803803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:50.804567 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:50.804993 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:50.949160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:50.957141 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:50.958900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:50.960298 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2a172e65-a6d2-48fc-a234-dcae5fff92d1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1721 microversion: 2.20 time: 0.167965 Nov 11 01:10:50.963123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 574/1178] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:50 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:51.019302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:51.020535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:51.028035 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:51.028562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:51.029538 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:51.029976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:51.141742 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9f9111f8-0fdf-48dd-91a2-bdf5ce72d3db tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 14 microversion: 2.1 time: 0.126330 Nov 11 01:10:51.142489 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 605/1179] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:51 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:10:51.978636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:51.979264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:51.985555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:51.985998 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:51.986768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:51.987234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.120561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:52.128499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:52.130733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:52.131922 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-34335012-06da-4ee1-b6ac-223fc61d46a4 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1664 microversion: 2.20 time: 0.157039 Nov 11 01:10:52.132490 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 575/1180] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:51 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:52.149811 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2148fe0-bcb0-48f4-b00b-25891a3b3e56"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:52.150984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:52.152020 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:52.152918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:52.157774 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.158224 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.158542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.159010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.159132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.159457 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.159776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.160831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.269872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-eb02b21e-d85f-44d7-835d-6e0aafd9ce1b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 1968 microversion: 2.1 time: 0.120860 Nov 11 01:10:52.270904 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 576/1181] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:52 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 1968 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:10:52.436956 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9a271f32-eb92-4e82-9543-24b326a2c82f tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291417 Nov 11 01:10:52.437762 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 606/1182] 10.222.0.52 () {62 vars in 1363 bytes} [Thu Nov 11 01:10:52 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:10:52.545938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:52.546511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:52.553296 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.553737 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.554504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.554933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.862778 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-6b742f95-8d28-4cab-bb9d-f809752c1a13 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-volume_attachments/d2148fe0-bcb0-48f4-b00b-25891a3b3e56" status: 202 len: 0 microversion: 2.20 time: 0.320921 Nov 11 01:10:52.863420 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 577/1183] 10.222.0.52 () {60 vars in 1456 bytes} [Thu Nov 11 01:10:52 2021] DELETE /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-volume_attachments/d2148fe0-bcb0-48f4-b00b-25891a3b3e56 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 11 01:10:52.918660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:52.919256 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:52.925472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.926050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:52.927026 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:52.927457 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:53.005915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-582850b0-b9bb-480d-bdcb-9ce8247333c2 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action" status: 202 len: 0 microversion: 2.20 time: 0.090922 Nov 11 01:10:53.006819 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 607/1184] 10.222.0.52 () {62 vars in 1318 bytes} [Thu Nov 11 01:10:52 2021] POST /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:10:53.014381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:53.015141 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:53.021712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:53.022169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:53.022975 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:53.023427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:53.158042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:53.165631 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:53.167167 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:53.168314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e9593736-1c7f-4320-b12f-0d1d751f2c55 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1672 microversion: 2.20 time: 0.157676 Nov 11 01:10:53.168873 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 578/1185] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:53 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:53.281231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:53.282168 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:53.290585 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:53.291053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:53.291831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:53.292259 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:53.387320 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-e1ac7ea8-3ecb-413b-b818-8b9f142a09a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 11817 microversion: 2.1 time: 0.109999 Nov 11 01:10:53.388126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 608/1186] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:53 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 11817 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:10:54.186868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:54.187504 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:54.193981 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:54.194425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:54.195224 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:54.195654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:54.333854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:54.342113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:54.343672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:54.344834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ac2bc332-1982-4968-b085-7796657daaa0 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.162038 Nov 11 01:10:54.345399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 579/1187] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:54 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:54.399055 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:54.400133 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:54.406899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:54.407442 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:54.408283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:54.408781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:54.508838 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6fdd4469-32d6-4550-903e-8fbeb98299f2 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 15977 microversion: 2.1 time: 0.114665 Nov 11 01:10:54.512433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 609/1188] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:54 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 15977 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:10:55.364529 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:55.365802 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:55.373935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:55.374870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:55.375890 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:55.376531 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:55.521598 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:10:55.523611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:55.526204 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:55.531510 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:55.532183 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:55.533562 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:55.534181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:55.534351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:55.536866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:55.538398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9b54d224-6660-4076-a3d7-31509f7aacdf tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.178683 Nov 11 01:10:55.539158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 580/1189] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:55 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:10:56.558236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:56.559209 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:56.569726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:56.570745 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:56.571828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:56.572369 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:56.759148 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:56.768010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:56.769970 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:56.771366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d6a5b12f-83cc-4cc5-a5e7-0798fc60ef81 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.217600 Nov 11 01:10:56.771938 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 581/1190] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:56 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:57.789623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:57.790386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:57.797220 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:57.797788 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:57.798677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:57.799240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:57.933320 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:57.943510 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:57.945151 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:57.946316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5c8dcb65-3874-449e-85af-8e37e3490d3e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.160673 Nov 11 01:10:57.946872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 582/1191] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:57 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:10:58.967861 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:10:58.969525 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:10:58.977030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:58.977474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:58.978263 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:10:58.978694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:10:59.111604 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:59.120196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:59.121702 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:10:59.122900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e9c821e4-584b-4fd0-ba46-ba293423b7cb tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.161774 Nov 11 01:10:59.124023 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 583/1192] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:10:58 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:00.141685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:00.142481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:00.149313 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:00.149743 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:00.150517 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:00.150960 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:00.294493 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:00.309031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:00.309031 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:00.309390 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4850d642-2373-403f-9850-ce142324811c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.171460 Nov 11 01:11:00.310294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 584/1193] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:00 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:01.328316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:01.329034 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:01.336359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:01.336807 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:01.337586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:01.338014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:01.475236 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:01.483436 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:01.484937 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:01.486110 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1f3240bd-c7ce-40a6-9625-979c07eab7cc tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.161634 Nov 11 01:11:01.486851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 585/1194] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:01 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:01.916352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:01.917426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:01.923385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:01.923857 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:01.924643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:01.925076 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:01.999071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5af3435e-ff4e-442f-9ad7-b30dae07d7c0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/action" status: 202 len: 0 microversion: 2.1 time: 0.086266 Nov 11 01:11:01.999704 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 586/1195] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:01 2021] POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:11:02.008186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:02.008878 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:02.014750 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:02.015232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:02.016011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:02.016451 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:02.170738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:02.179187 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1702f3b6-e72a-4050-ac94-246d442ba9cd tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1752 microversion: 2.1 time: 0.175101 Nov 11 01:11:02.179766 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 587/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:02 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:02.504902 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:02.505551 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:02.511793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:02.512237 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:02.512999 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:02.513429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:02.666077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:02.674521 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:02.676021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:02.678040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5412cd6d-65c9-44b3-af36-b5344695212d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.176016 Nov 11 01:11:02.678600 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 588/1197] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:02 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:03.196627 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:03.197154 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:03.203055 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:03.203503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:03.204282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:03.204710 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:03.359253 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:03.367896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f9e4409e-77b0-4948-bda6-9f5526160146 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1752 microversion: 2.1 time: 0.175111 Nov 11 01:11:03.368469 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 589/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:03 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:03.699004 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:03.699813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:03.705987 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:03.706428 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:03.707217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:03.707646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:03.847516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:03.855603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:03.857123 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:03.858266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-816897fa-60d6-46b0-8b1f-113a1c9f1fb5 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.162986 Nov 11 01:11:03.859196 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 590/1199] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:03 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:04.385003 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:04.385617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:04.391457 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:04.391910 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:04.392689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:04.393127 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:04.545153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:04.553065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-669c3329-a5b5-4c36-94d9-07b163281e20 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1752 microversion: 2.1 time: 0.171904 Nov 11 01:11:04.553631 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 591/1200] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:04 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:04.877347 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:04.877963 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:04.884793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:04.885242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:04.886028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:04.886460 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:05.057297 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:05.065021 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:05.066514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:05.067690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-693bf512-fbcb-4556-a252-d5690fa18512 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.194223 Nov 11 01:11:05.068252 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 592/1201] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:04 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:05.569326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:05.570238 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:05.577117 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:05.577704 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:05.578590 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:05.579128 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:05.724515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:05.733251 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cad65a23-5aee-4298-a272-5fc7b976edb0 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1752 microversion: 2.1 time: 0.167589 Nov 11 01:11:05.733850 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 593/1202] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:05 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:06.086603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:06.087358 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:06.093939 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:06.094391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:06.095214 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:06.095653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:06.237071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:06.246603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:06.248378 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:06.249636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dc267157-7ddf-48b1-a73b-41db79fd158a tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.167400 Nov 11 01:11:06.250186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 594/1203] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:06 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:06.751102 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:06.752326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:06.760630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:06.761458 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:06.762881 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:06.763992 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:06.923763 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:06.931784 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e036bc57-f820-405e-979f-1e19bd1a14b8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1752 microversion: 2.1 time: 0.184477 Nov 11 01:11:06.932354 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 595/1204] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:06 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:07.268563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:07.269360 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:07.276602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:07.277054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:07.277851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:07.278291 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:07.430456 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:07.438888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:07.440409 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:07.441562 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cfb783b1-dde1-47c7-bedb-253c95053987 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.176743 Nov 11 01:11:07.442118 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 596/1205] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:07 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:07.949052 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:07.949675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:07.956306 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:07.956956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:07.958136 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:07.958918 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:08.053402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3a8aef6f-5b4b-4d10-946b-7c90ae235f2d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28221 microversion: 2.1 time: 12.536264 Nov 11 01:11:08.057824 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 610/1206] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:10:55 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28221 bytes in 12539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:11:08.153556 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:08.161732 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-de40e931-130e-40b8-b0cd-f3ef59105c98 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1752 microversion: 2.1 time: 0.216452 Nov 11 01:11:08.162398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 597/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:07 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:08.463033 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:08.463738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:08.470806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:08.471281 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:08.472054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:08.472488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:08.604973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:08.612876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:08.614371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:08.615564 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-60da2ae4-0429-49ee-9516-1039bf44a696 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.157543 Nov 11 01:11:08.616118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 611/1208] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:08 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:09.065871 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:09.066827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:09.073952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:09.074397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:09.075211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:09.075643 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:09.178714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:09.179347 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:09.184043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-7fd73f91-a96f-47ee-8d41-07077d87c9a5 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28221 microversion: 2.1 time: 0.121745 Nov 11 01:11:09.188039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 598/1209] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:09 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:09.188203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:09.188203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:09.188203 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:09.188568 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:09.339118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:09.347069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7c5da4d0-efa4-4f1c-a78e-f1a6b1963ae9 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.171930 Nov 11 01:11:09.347627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 612/1210] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:09 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:09.634071 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:09.634772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:09.641579 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:09.642026 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:09.642801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:09.643262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:09.776188 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:09.784266 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:09.785773 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:09.786932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cff132e6-9988-4e2f-b4ff-0afa77dc05b1 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.156912 Nov 11 01:11:09.787511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 599/1211] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:09 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:10.196369 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:10.197332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:10.203629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:10.204075 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:10.204836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:10.205265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:10.310957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8ee2641f-b0bb-410a-ad58-1efda55047aa tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28221 microversion: 2.1 time: 0.118744 Nov 11 01:11:10.311712 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 613/1212] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:10 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:10.364052 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:10.364648 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:10.371769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:10.372203 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:10.372964 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:10.373387 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:10.515561 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:10.523301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d2ca014a-c7df-499a-9c1e-e0ef07aa9b8c tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.162749 Nov 11 01:11:10.524439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 600/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:10 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:10.807130 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:10.807885 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:10.815227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:10.815671 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:10.816443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:10.816870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:10.950228 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:10.958073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:10.959614 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:10.960785 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-337b0794-2d5b-434f-ad90-6957d774da82 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.158927 Nov 11 01:11:10.961535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 614/1214] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:10 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:11.322602 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:11.323574 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:11.329800 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:11.330245 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:11.331037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:11.331470 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:11.436295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-eba89acf-1ea1-4675-be59-c2b76df193a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28511 microversion: 2.1 time: 0.117245 Nov 11 01:11:11.437098 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 601/1215] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:11 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:11.540841 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:11.541454 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:11.547721 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:11.548166 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:11.548934 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:11.549365 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:11.690504 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:11.698648 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-316d6cd9-4557-4588-b552-d2c6817091cc tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.161557 Nov 11 01:11:11.699246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 615/1216] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:11 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:11.980113 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:11.980799 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:11.987521 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:11.987962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:11.988726 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:11.989153 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:12.124066 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:12.132165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:12.134316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:12.135571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-854c0111-9dfa-4599-bdb8-57ba36b2b6ef tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.159952 Nov 11 01:11:12.136081 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 602/1217] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:11 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:12.447760 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:12.448675 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:12.454789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:12.455266 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:12.456040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:12.456472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:12.639294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cd9b5e85-80c5-4dd3-9ed1-78e96ee0e6b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28679 microversion: 2.1 time: 0.194962 Nov 11 01:11:12.639991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 616/1218] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:12 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:12.716216 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:12.716754 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:12.723872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:12.724318 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:12.725088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:12.725516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:12.868488 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:12.876212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b825ff2d-5579-42c5-bab2-f7d1c31a0c70 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.164027 Nov 11 01:11:12.876994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 603/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:12 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:13.154882 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:13.155602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:13.162373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:13.162816 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:13.163607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:13.164039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:13.300603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:13.309222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:13.310702 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:13.311884 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ed71d559-ce51-497d-8852-7d7edd3f8370 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.161110 Nov 11 01:11:13.312431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 617/1220] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:13 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:13.650693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:13.651647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:13.657798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:13.658247 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:13.659082 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:13.659522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:13.756040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cd65bd30-3e82-4976-b99e-9eab74e0e31d tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28679 microversion: 2.1 time: 0.109074 Nov 11 01:11:13.756711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 604/1221] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:13 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28679 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:13.893205 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:13.893736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:13.900069 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:13.900512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:13.901279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:13.901738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:14.042295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:14.049969 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-6b09be27-9067-4d13-a5bc-ee2634a1992a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.160469 Nov 11 01:11:14.050522 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 618/1222] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:13 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:14.331506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:14.332198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:14.339293 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:14.339994 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:14.340775 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:14.341208 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:14.352042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-fa5b5e67-247e-464f-ab50-8fda720572da req-4a0d392a-bd7c-41c2-89ff-a60cc55f37cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "name": "network-vif-plugged", "status": "completed", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:14.353995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:11:14.353995 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:11:14.361613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-fa5b5e67-247e-464f-ab50-8fda720572da req-4a0d392a-bd7c-41c2-89ff-a60cc55f37cf service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:14.362152 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-fa5b5e67-247e-464f-ab50-8fda720572da req-4a0d392a-bd7c-41c2-89ff-a60cc55f37cf service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:14.373773 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-fa5b5e67-247e-464f-ab50-8fda720572da req-4a0d392a-bd7c-41c2-89ff-a60cc55f37cf service nova] Creating event network-vif-plugged:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:11:14.378716 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-fa5b5e67-247e-464f-ab50-8fda720572da req-4a0d392a-bd7c-41c2-89ff-a60cc55f37cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030784 Nov 11 01:11:14.379595 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 619/1223] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:11:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:14.481500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:14.489169 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:14.490661 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:14.491842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b291e550-2f99-4ca2-9dd0-bff1296b7f0c tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.164409 Nov 11 01:11:14.493058 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 605/1224] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:14 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:14.768523 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:14.769438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:14.776113 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:14.776561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:14.777332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:14.777763 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:15.068039 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:15.068650 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:15.075032 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:15.075481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:15.076262 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:15.076718 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:15.144456 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b170c290-da17-44ff-a527-89c8d02090cc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28679 microversion: 2.1 time: 0.379934 Nov 11 01:11:15.148976 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 620/1225] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:14 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28679 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:15.221734 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:15.229764 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0c1a50e2-c2cf-4dc0-ae70-27c80c87c539 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.165419 Nov 11 01:11:15.230334 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 606/1226] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:15 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:15.512609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:15.513214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:15.519996 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:15.520437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:15.521201 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:15.521624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:15.651864 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:15.659929 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:15.661424 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:15.662573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5dcd1a1a-a146-4e2a-a6d9-908373036d66 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.155117 Nov 11 01:11:15.663155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 621/1227] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:15 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:16.156628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:16.157426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:16.164381 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:16.164838 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:16.165618 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:16.166051 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:16.247352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:16.248003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:16.254190 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:16.254876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:16.255689 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:16.256126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:16.277026 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-12d6d672-ff7f-4d33-8eec-2219065be748 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28679 microversion: 2.1 time: 0.123906 Nov 11 01:11:16.281275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 607/1228] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:16 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28679 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:16.403347 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:16.411107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dc162845-a968-41c7-8710-d70aef2273de tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.167475 Nov 11 01:11:16.411660 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 622/1229] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:16 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:11:16.681587 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:16.682191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:16.689120 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:16.689572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:16.690344 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:16.690772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:16.826925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:16.834787 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:16.837056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:16.838194 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2393d827-3432-4901-8479-78ff5eab2c5d tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1730 microversion: 2.20 time: 0.161064 Nov 11 01:11:16.838748 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 608/1230] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:16 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:17.289039 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:17.290165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:17.296637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:17.297087 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:17.297856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:17.298284 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:17.389397 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-51ccd6f6-c1fa-4ca7-b21b-095f08108804 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 28679 microversion: 2.1 time: 0.103950 Nov 11 01:11:17.390030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 623/1231] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:17 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 28679 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:17.428700 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:17.429957 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:17.436743 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:17.437330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:17.438405 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:17.438864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:17.581305 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:17.589030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9a3c5866-f219-4a34-90f6-bd68234295d1 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.163990 Nov 11 01:11:17.589853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 609/1232] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:17 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:17.857926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:17.858553 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:17.865431 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:17.865880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:17.866678 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:17.867728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:18.004590 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:18.012242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:18.013744 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:18.014927 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f3a898fd-a051-4255-bdc4-243fb2dced40 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1717 microversion: 2.20 time: 0.161213 Nov 11 01:11:18.015518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 624/1233] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:17 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:18.401780 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:18.402646 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:18.408872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:18.409307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:18.410068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:18.410491 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:18.516672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a317e99d-b8b0-40d5-be8e-17859acf3447 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 30012 microversion: 2.1 time: 0.119460 Nov 11 01:11:18.517301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 610/1234] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:18 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 30012 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:18.605353 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:18.605959 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:18.612181 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:18.612629 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:18.613399 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:18.613829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:18.758619 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:18.766378 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-80528c73-9d12-439a-a9b9-1e6ab5c63213 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.164768 Nov 11 01:11:18.766928 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 625/1235] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:18 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:19.529385 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:19.530398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:19.537218 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:19.537664 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:19.538437 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:19.538876 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:19.633741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f394cc4a-d9a4-484b-9a0e-889cb9f3f5e8 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 31948 microversion: 2.1 time: 0.108263 Nov 11 01:11:19.634415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 611/1236] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:19 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 31948 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:19.784028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:19.784632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:19.790825 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:19.791299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:19.792065 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:19.792495 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:19.935943 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:19.943602 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-b676b5bc-613e-4430-9e1c-2eab86a81c2f tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.163230 Nov 11 01:11:19.944162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 626/1237] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:19 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:20.645962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:20.646979 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:20.656014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:20.656457 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:20.657240 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:20.657671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:20.755089 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-68443739-b77c-4f88-bc91-76d9c078f7bc tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 33354 microversion: 2.1 time: 0.112984 Nov 11 01:11:20.755623 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 612/1238] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:20 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 33354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:20.961694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:20.962303 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:20.969535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:20.969535 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:20.970280 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:20.970713 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:21.110422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:21.118138 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-db1e3d82-1399-49f6-81a7-a847898a2ae5 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.160834 Nov 11 01:11:21.118696 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 627/1239] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:20 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:21.767334 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:21.768335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:21.775294 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:21.775747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:21.776523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:21.776956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:21.880687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-18de0260-50e6-487c-aa3c-0a50f9af49b1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 34274 microversion: 2.1 time: 0.117359 Nov 11 01:11:21.881310 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 613/1240] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:21 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 34274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:11:22.134916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:22.135561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:22.142335 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:22.142794 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:22.143600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:22.144036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:22.287516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:22.296141 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2cd7ae77-e6e6-42b9-b44b-25077eedf1fb tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.164945 Nov 11 01:11:22.296706 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 628/1241] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:22 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:22.892774 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:22.893791 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:22.901227 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:22.901677 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:22.902454 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:22.902888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:23.030314 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2225bbf5-1973-4d86-9455-72e2270776a1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 35272 microversion: 2.1 time: 0.141399 Nov 11 01:11:23.030991 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 614/1242] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:22 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 35272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:23.315240 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:23.315844 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:23.322778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:23.323245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:23.324011 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:23.324437 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:23.477506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:23.485196 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-dbd9494e-1645-4f53-95d5-aa4160e6e9d2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.174934 Nov 11 01:11:23.485753 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 629/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:23 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:24.042809 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:24.043843 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:24.050592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:24.051063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:24.051831 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:24.052265 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:24.170380 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5d847745-18b6-46ed-b1f4-99e06a514f74 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 36249 microversion: 2.1 time: 0.132051 Nov 11 01:11:24.171042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 615/1244] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:24 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 36249 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:24.502730 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:24.503374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:24.509709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:24.510144 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:24.510903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:24.511360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:24.660145 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:24.667779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a8c2c10c-7623-43f3-8b53-2c0000d22891 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1757 microversion: 2.1 time: 0.168755 Nov 11 01:11:24.668341 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 630/1245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:24 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:25.182473 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:25.183499 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:25.190360 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:25.190803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:25.191598 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:25.192037 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:25.300560 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c166d759-6727-4a3a-ad21-8cae6c71054e tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 37301 microversion: 2.1 time: 0.122628 Nov 11 01:11:25.301528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 616/1246] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:25 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 37301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:25.684627 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:25.685151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:25.691516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:25.691962 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:25.692729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:25.693153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:25.836494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:25.845330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-c1fc7a9e-704a-4eb4-9fef-3399c1524b76 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1760 microversion: 2.1 time: 0.164485 Nov 11 01:11:25.845900 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 631/1247] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:25 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:26.313302 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:26.314326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:26.321147 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:26.322111 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:26.322874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:26.323328 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:26.422319 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-06b6f199-cefe-4c02-b675-fbfe31f17e9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 38210 microversion: 2.1 time: 0.112907 Nov 11 01:11:26.422973 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 617/1248] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:26 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 38210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:27.433892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:27.434841 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:27.441162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:27.441605 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:27.442662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:27.443133 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:27.532272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2ce4d912-f9b0-4fe0-b827-5a91841ac7a4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 38210 microversion: 2.1 time: 0.102238 Nov 11 01:11:27.532902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 632/1249] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:27 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 38210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:28.545244 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:28.546247 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:28.553023 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:28.553464 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:28.554232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:28.554660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:28.644793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-eb83e02a-bee3-429c-ae72-82a80e14f27b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 38210 microversion: 2.1 time: 0.104114 Nov 11 01:11:28.645733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 618/1250] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:28 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 38210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 01:11:29.656943 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:29.657861 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:29.664630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:29.665106 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:29.665856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:29.666283 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:29.772918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-60416a98-a1b8-489c-8980-bde7b8be1305 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action" status: 200 len: 38341 microversion: 2.1 time: 0.119983 Nov 11 01:11:29.773840 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 633/1251] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:11:29 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/action => generated 38341 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 01:11:29.784433 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:29.785001 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:29.792362 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:29.792810 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:29.793589 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:29.794019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:29.818717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-145fc0f2-7a78-4e23-a507-8acd9b77f0df tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/ips" status: 200 len: 146 microversion: 2.1 time: 0.038287 Nov 11 01:11:29.819316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 619/1252] 10.222.0.52 () {58 vars in 1247 bytes} [Thu Nov 11 01:11:29 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:31.115278 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4746432-fa30-4662-bc88-853a1e23921b"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:31.116411 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:31.123789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:31.124232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:31.124993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:31.125419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:31.373551 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d5170d02-8fb9-49a9-8205-d0351b685c07 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262236 Nov 11 01:11:31.374143 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 634/1253] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:11:31 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:38.823330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:38.824242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:38.830347 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:38.830789 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:38.831736 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:38.832163 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:38.861973 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c68d7785-088d-4025-80b5-ffbb332ce7b0 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Nov 11 01:11:38.862512 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 620/1254] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:11:38 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:38.873505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:38.874162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:38.880434 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:38.880877 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:38.881644 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:38.882076 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:38.909306 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a73b6438-6d63-4e18-aaa1-daf6055c978f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/c4746432-fa30-4662-bc88-853a1e23921b" status: 200 len: 194 microversion: 2.1 time: 0.040944 Nov 11 01:11:38.909878 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 635/1255] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Nov 11 01:11:38 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/c4746432-fa30-4662-bc88-853a1e23921b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:40.214735 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b1e3c8c-d25f-4bc4-b68a-e57d59fe0044"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:40.215813 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:40.222028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:40.222412 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:40.223213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:40.223655 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:40.494403 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8a46ab1d-b95d-48d7-b85f-61b782ddac92 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282623 Nov 11 01:11:40.494996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 621/1256] 10.222.0.52 () {60 vars in 1322 bytes} [Thu Nov 11 01:11:40 2021] POST /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:47.947638 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:47.948601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:47.954813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:47.955299 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:47.956099 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:47.956534 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:47.986784 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-41828826-f0af-4c83-9693-83be11d23b54 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042935 Nov 11 01:11:47.987360 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 636/1257] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:11:47 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:48.267746 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:48.268326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:48.274694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:48.275704 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:48.276640 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:48.277070 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:48.304794 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ddf3438d-c1ae-450e-8cb0-e9a12ed4b384 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/c4746432-fa30-4662-bc88-853a1e23921b" status: 200 len: 194 microversion: 2.1 time: 0.041180 Nov 11 01:11:48.305368 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 622/1258] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Nov 11 01:11:48 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/c4746432-fa30-4662-bc88-853a1e23921b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:48.315253 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:48.315736 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:48.321790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:48.322425 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:48.323798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:48.324580 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:48.405505 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lazy-loading 'services' on Instance uuid 1a93927e-164e-4860-bf84-1abd71f70a7e {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:11:48.472332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8ed176c3-d9d8-4a42-af3c-1189bcecb268 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/c4746432-fa30-4662-bc88-853a1e23921b" status: 202 len: 0 microversion: 2.1 time: 0.160581 Nov 11 01:11:48.472970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 637/1259] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:11:48 2021] DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/c4746432-fa30-4662-bc88-853a1e23921b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:11:50.633446 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:50.633954 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:50.641322 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:50.641776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:50.642616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:50.643461 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:50.677636 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d5698d3a-84b9-4b11-bf3b-dc771ef2c22f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/3b1e3c8c-d25f-4bc4-b68a-e57d59fe0044" status: 200 len: 194 microversion: 2.1 time: 0.047940 Nov 11 01:11:50.678221 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 623/1260] 10.222.0.52 () {58 vars in 1412 bytes} [Thu Nov 11 01:11:50 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/3b1e3c8c-d25f-4bc4-b68a-e57d59fe0044 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:50.689661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:50.690230 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:50.696160 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:50.696603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:50.698276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:50.698722 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:50.775073 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lazy-loading 'services' on Instance uuid 1a93927e-164e-4860-bf84-1abd71f70a7e {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:11:50.840794 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a3e5d518-01a6-471f-9b6c-8c2e4f6f362f tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/3b1e3c8c-d25f-4bc4-b68a-e57d59fe0044" status: 202 len: 0 microversion: 2.1 time: 0.155447 Nov 11 01:11:50.841361 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 638/1261] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:11:50 2021] DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments/3b1e3c8c-d25f-4bc4-b68a-e57d59fe0044 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:11:51.989181 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:51.990146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:51.996765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:51.997208 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:51.997969 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:51.998398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.027086 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-95c8061e-1128-4a49-beed-f8387a847a9b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041701 Nov 11 01:11:52.027681 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 624/1262] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:11:51 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:11:52.130132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:52.131218 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:52.138118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:52.138604 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.139406 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:52.139839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.167561 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-43c63b11-c778-46bf-a3d9-6ad72e5139c1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042029 Nov 11 01:11:52.168093 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 639/1263] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:11:52 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:11:52.222731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:52.223257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:52.229496 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:52.229933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.230691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:52.231155 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.254874 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:11:52.326076 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3a8cfb26-5b9a-449d-9c44-496ef7c2f846 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 204 len: 0 microversion: 2.1 time: 0.106646 Nov 11 01:11:52.326856 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 625/1264] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:11:52 2021] DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:11:52.335991 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:52.336597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:52.342621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:52.343129 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.343890 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:52.344319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:52.473655 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:52.481560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4925876f-ff8a-4e63-a68e-79af8651aca7 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1675 microversion: 2.1 time: 0.150180 Nov 11 01:11:52.482119 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 640/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:52 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:53.499583 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:53.500284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:53.506420 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:53.506868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:53.507673 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:53.508114 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:53.641380 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:53.648569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8b5b709f-be3f-4ee2-9d31-a09abfa1dfc1 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1675 microversion: 2.1 time: 0.153059 Nov 11 01:11:53.649135 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 626/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:53 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:54.665497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:54.666150 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:54.673043 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:54.673496 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:54.674290 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:54.674723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:54.806723 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:54.814422 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-698b4af2-ff21-40aa-9e65-d1149ffdd8ab tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1675 microversion: 2.1 time: 0.152621 Nov 11 01:11:54.815006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 641/1267] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:54 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:55.636772 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-a3b61fae-65ff-42dd-a3fe-c7b3cfe16a43 req-ffe383b2-2511-4b96-b95e-5a3d3f8ebee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a93927e-164e-4860-bf84-1abd71f70a7e", "name": "network-vif-deleted", "tag": "44f556ed-442c-489b-8797-5d8ba69793e5"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:55.641010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:11:55.641010 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:11:55.650823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-a3b61fae-65ff-42dd-a3fe-c7b3cfe16a43 req-ffe383b2-2511-4b96-b95e-5a3d3f8ebee7 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:55.650823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-a3b61fae-65ff-42dd-a3fe-c7b3cfe16a43 req-ffe383b2-2511-4b96-b95e-5a3d3f8ebee7 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:55.666092 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-a3b61fae-65ff-42dd-a3fe-c7b3cfe16a43 req-ffe383b2-2511-4b96-b95e-5a3d3f8ebee7 service nova] Creating event network-vif-deleted:44f556ed-442c-489b-8797-5d8ba69793e5 for instance 1a93927e-164e-4860-bf84-1abd71f70a7e on hv-cinder-81708 Nov 11 01:11:55.673596 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-a3b61fae-65ff-42dd-a3fe-c7b3cfe16a43 req-ffe383b2-2511-4b96-b95e-5a3d3f8ebee7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041279 Nov 11 01:11:55.674154 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 627/1268] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:55.831497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:55.832107 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:55.838294 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:55.838901 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:55.840053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:55.840480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:55.870775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:55.871246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:55.871684 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lazy-loading 'fault' on Instance uuid 1a93927e-164e-4860-bf84-1abd71f70a7e {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:11:55.911576 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12fd7b58fb46a79f92729e3ef7a105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65821f142fe445b8388094f872c5457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:55.919030 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3d0312fb-4240-4d3c-bb98-002d150b3b9c tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 200 len: 1328 microversion: 2.1 time: 0.091084 Nov 11 01:11:55.919555 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 642/1269] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:55 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:56.937463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:56.938143 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:56.944762 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:56.945207 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:56.945989 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:56.946418 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:56.960784 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] HTTP exception thrown: Instance 1a93927e-164e-4860-bf84-1abd71f70a7e could not be found. Nov 11 01:11:56.961803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Returning 404 to user: Instance 1a93927e-164e-4860-bf84-1abd71f70a7e could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:11:56.962261 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b68075b5-fb52-4ad5-8bb0-75c4c42dce53 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 404 len: 111 microversion: 2.1 time: 0.028940 Nov 11 01:11:56.962822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 628/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:56 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:11:56.971737 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-80e589b8-181d-4f00-80a2-aa1ebbe12865 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '.version_select at 0x7fd364177790>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:56.990134 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-80e589b8-181d-4f00-80a2-aa1ebbe12865 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507753466" status: 202 len: 0 microversion: 2.1 time: 0.022369 Nov 11 01:11:56.994246 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 643/1271] 10.222.0.52 () {58 vars in 1220 bytes} [Thu Nov 11 01:11:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507753466 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:11:57.042500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:57.043840 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:57.051018 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.051464 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.052259 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.052727 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.084680 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2f0fa23a-347b-4d78-94f2-5d805c473784 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045992 Nov 11 01:11:57.085254 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 629/1272] 10.222.0.52 () {60 vars in 1342 bytes} [Thu Nov 11 01:11:57 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:57.146487 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:57.147004 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:57.158618 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.159172 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.159950 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.160547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.204016 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:11:57.295269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-3c075395-85a4-46e4-bac6-d666c6ddc870 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 204 len: 0 microversion: 2.20 time: 0.152586 Nov 11 01:11:57.295984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 644/1273] 10.222.0.52 () {60 vars in 1279 bytes} [Thu Nov 11 01:11:57 2021] DELETE /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 11 01:11:57.304272 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:57.304947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:57.311415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.312040 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.312829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.313478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.541834 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:57.552670 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:57.554522 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:57.556724 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-a06ab7ec-b839-408a-a377-b684a4969508 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.256139 Nov 11 01:11:57.569962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 630/1274] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:57 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 01:11:57.645667 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:57.646608 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:57.656654 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.657838 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.658737 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-b3564e53-4456-473c-808a-3dc5dc0e33e9 req-5019d36b-ed71-44ed-9101-d120e6903848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:57.661574 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.663012 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.663870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:11:57.663870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:11:57.676687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-b3564e53-4456-473c-808a-3dc5dc0e33e9 req-5019d36b-ed71-44ed-9101-d120e6903848 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.677316 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-b3564e53-4456-473c-808a-3dc5dc0e33e9 req-5019d36b-ed71-44ed-9101-d120e6903848 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.690798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-b3564e53-4456-473c-808a-3dc5dc0e33e9 req-5019d36b-ed71-44ed-9101-d120e6903848 service nova] Creating event network-changed:e56a395c-77ef-4622-a62e-fedb27621bdb for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 on hv-cinder-81708 Nov 11 01:11:57.698972 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-b3564e53-4456-473c-808a-3dc5dc0e33e9 req-5019d36b-ed71-44ed-9101-d120e6903848 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046274 Nov 11 01:11:57.704211 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 631/1275] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:11:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:11:57.707198 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:11:57.808754 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-eb0ea9e6-cd37-4a1a-9ba0-841a1faa5aa0 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "DELETE /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 204 len: 0 microversion: 2.1 time: 0.167698 Nov 11 01:11:57.809833 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 645/1276] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:11:57 2021] DELETE /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:11:57.820333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:57.821354 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:57.838663 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.839787 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.840642 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:57.841093 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:57.996572 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:58.004973 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-f5dbb93c-0e61-466b-a043-5bbbfe2fa023 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1568 microversion: 2.1 time: 0.189908 Nov 11 01:11:58.005717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 632/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:57 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:58.576251 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:58.576945 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:58.583374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:58.583820 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:58.584599 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:58.585021 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:58.720687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:58.728728 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:58.730239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:58.731443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a793a4d6-4134-44bd-94e4-6f8314f0c593 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1723 microversion: 2.20 time: 0.159279 Nov 11 01:11:58.732002 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 646/1278] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:58 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:59.022736 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:59.023386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:59.029925 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:59.030372 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:59.031190 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:59.031625 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:59.162570 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:59.170970 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-509460c1-a6d1-49ed-afb5-498490021231 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1449 microversion: 2.1 time: 0.151866 Nov 11 01:11:59.171564 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 633/1279] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:11:59 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:11:59.749628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:59.750807 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:59.757208 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:59.757650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:59.758427 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:59.758866 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:59.823984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:59.831781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:59.833265 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d1219c765c74dcc8bb8b61d4615e0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01554f5a96c46afb1983c71a9513e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:11:59.834414 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-8d876363-ac60-4c5e-8f95-bd0a6c37a837 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 200 len: 1655 microversion: 2.20 time: 0.088643 Nov 11 01:11:59.834987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 647/1280] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:11:59 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 01:11:59.984172 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:11:59.984757 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:11:59.991284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:59.991797 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:59.992793 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:11:59.993278 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:11:59.997932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-d4fbef5e-06b6-4037-b4e4-f82fed637a98 req-ea79b52e-7c3e-498e-8b94-db62c6ea0c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce8e836-308a-4cdb-8e70-a3d3b431da6d", "name": "network-vif-deleted", "tag": "1f7f5df1-b155-4d43-99ac-2e3dd6657296"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:11:59.999436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:11:59.999436 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:12:00.013376 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d4fbef5e-06b6-4037-b4e4-f82fed637a98 req-ea79b52e-7c3e-498e-8b94-db62c6ea0c8c service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.013945 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d4fbef5e-06b6-4037-b4e4-f82fed637a98 req-ea79b52e-7c3e-498e-8b94-db62c6ea0c8c service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.015415 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] HTTP exception thrown: Instance 1a93927e-164e-4860-bf84-1abd71f70a7e could not be found. Nov 11 01:12:00.016212 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Returning 404 to user: Instance 1a93927e-164e-4860-bf84-1abd71f70a7e could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:00.017258 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e4fef7f5-44f8-4db7-b042-f5a21f7dade4 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 404 len: 111 microversion: 2.1 time: 0.036998 Nov 11 01:12:00.018013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 634/1281] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:11:59 2021] DELETE /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:00.030966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-d4fbef5e-06b6-4037-b4e4-f82fed637a98 req-ea79b52e-7c3e-498e-8b94-db62c6ea0c8c service nova] Creating event network-vif-deleted:1f7f5df1-b155-4d43-99ac-2e3dd6657296 for instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d on hv-cinder-81708 Nov 11 01:12:00.036903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-d4fbef5e-06b6-4037-b4e4-f82fed637a98 req-ea79b52e-7c3e-498e-8b94-db62c6ea0c8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043102 Nov 11 01:12:00.037771 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 648/1282] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:11:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:12:00.045506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:00.046164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 1a93927e-164e-4860-bf84-1abd71f70a7e] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:00.054014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.054471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.055336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.056246 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.094257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] HTTP exception thrown: Instance 1a93927e-164e-4860-bf84-1abd71f70a7e could not be found. Nov 11 01:12:00.094860 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Returning 404 to user: Instance 1a93927e-164e-4860-bf84-1abd71f70a7e could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:00.097903 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d708858b-1a25-46f3-b5e6-83292e6ddd2b tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e" status: 404 len: 111 microversion: 2.1 time: 0.059548 Nov 11 01:12:00.100440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 635/1283] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:00 2021] GET /compute/v2.1/servers/1a93927e-164e-4860-bf84-1abd71f70a7e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:00.188245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:00.192408 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:00.205334 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.205799 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.206640 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.209948 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.389132 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:00.396332 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ce6ce90a-eac8-4ac1-b1ac-e5cc246d9f9a tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1449 microversion: 2.1 time: 0.212084 Nov 11 01:12:00.396887 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 649/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:00 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1449 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:12:00.853391 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:00.854720 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:00.860497 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.860947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.861727 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:00.862160 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:00.875222 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] HTTP exception thrown: Instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d could not be found. Nov 11 01:12:00.875807 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Returning 404 to user: Instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:00.876629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c4a156a8-a526-47e2-8392-559dce8d1381 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 404 len: 111 microversion: 2.20 time: 0.027140 Nov 11 01:12:00.877406 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 636/1285] 10.222.0.52 () {60 vars in 1276 bytes} [Thu Nov 11 01:12:00 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 11 01:12:00.885843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-28d5e318-9014-4ca5-91bb-1d22961e0924 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '.version_select at 0x7fd364177790>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:00.906607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-28d5e318-9014-4ca5-91bb-1d22961e0924 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976134965" status: 204 len: 0 microversion: 2.20 time: 0.024780 Nov 11 01:12:00.907399 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 650/1286] 10.222.0.52 () {60 vars in 1258 bytes} [Thu Nov 11 01:12:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976134965 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 11 01:12:01.287481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:01.288029 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:01.295897 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.296616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.297586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.298019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.312798 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] HTTP exception thrown: Instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 could not be found. Nov 11 01:12:01.313668 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Returning 404 to user: Instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:01.314672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1ba49d55-709d-48d3-a1e5-3c0165c57632 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 404 len: 111 microversion: 2.1 time: 0.030914 Nov 11 01:12:01.315429 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 637/1287] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:12:01 2021] DELETE /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:01.325738 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:01.327641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] [instance: 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:01.337698 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.338626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.339865 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.340308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.354243 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] HTTP exception thrown: Instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 could not be found. Nov 11 01:12:01.354842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] Returning 404 to user: Instance 64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:01.355872 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-61c4108a-588b-482f-9abc-0ef6a8f45593 tempest-AttachVolumeTestJSON-259715532 tempest-AttachVolumeTestJSON-259715532-project] 10.222.0.52 "GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8" status: 404 len: 111 microversion: 2.1 time: 0.036134 Nov 11 01:12:01.359042 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 651/1288] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:01 2021] GET /compute/v2.1/servers/64bdbf3e-eb0e-4c4d-bb06-61cffd525ca8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 01:12:01.413783 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:01.414388 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:01.421073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.422033 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.423084 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.423731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.466130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:01.466601 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:01.467079 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.objects.instance [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lazy-loading 'fault' on Instance uuid 93554b91-4f2b-4c98-ac74-341ac3c847f0 {{(pid=116015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:12:01.514687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d2b8de9b734a48957f0aed750617f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dff1f2fb612458e95b9346b3d29040d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:01.524068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-01663e37-8409-4160-87e6-21790fd91350 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 200 len: 1224 microversion: 2.1 time: 0.114370 Nov 11 01:12:01.525019 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 638/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:01 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:02.070328 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-433431e3-00ff-447a-aff1-d48915c7f780 req-40078272-e22d-4b8c-b1c5-008bb836e7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93554b91-4f2b-4c98-ac74-341ac3c847f0", "name": "network-vif-deleted", "tag": "e56a395c-77ef-4622-a62e-fedb27621bdb"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:02.071932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:12:02.071932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:12:02.080115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-433431e3-00ff-447a-aff1-d48915c7f780 req-40078272-e22d-4b8c-b1c5-008bb836e7fd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.080641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-433431e3-00ff-447a-aff1-d48915c7f780 req-40078272-e22d-4b8c-b1c5-008bb836e7fd service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.092346 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-433431e3-00ff-447a-aff1-d48915c7f780 req-40078272-e22d-4b8c-b1c5-008bb836e7fd service nova] Creating event network-vif-deleted:e56a395c-77ef-4622-a62e-fedb27621bdb for instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 on hv-cinder-81708 Nov 11 01:12:02.097573 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-433431e3-00ff-447a-aff1-d48915c7f780 req-40078272-e22d-4b8c-b1c5-008bb836e7fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030665 Nov 11 01:12:02.098176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 652/1290] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:12:02.543733 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:02.546078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] [instance: 93554b91-4f2b-4c98-ac74-341ac3c847f0] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:02.552928 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.553575 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.554554 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.555068 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.571978 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] HTTP exception thrown: Instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 could not be found. Nov 11 01:12:02.572580 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Returning 404 to user: Instance 93554b91-4f2b-4c98-ac74-341ac3c847f0 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:02.573631 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-c932f091-60d9-486a-914e-7767a771ab10 tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0" status: 404 len: 111 microversion: 2.1 time: 0.035842 Nov 11 01:12:02.574532 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 639/1291] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:02 2021] GET /compute/v2.1/servers/93554b91-4f2b-4c98-ac74-341ac3c847f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:02.766316 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-4162a4c2-ed72-4c4d-81f6-51ba10100dae tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] Calling method '.version_select at 0x7fd3641103a0>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:02.777859 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:02.778362 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:02.785768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.786460 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.787351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.787864 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.801603 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] HTTP exception thrown: Instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d could not be found. Nov 11 01:12:02.802202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Returning 404 to user: Instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:02.803063 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-69c266b7-657c-41cb-9ef6-bad5ce35790e tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 404 len: 111 microversion: 2.1 time: 0.028971 Nov 11 01:12:02.803613 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 640/1292] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:12:02 2021] DELETE /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 01:12:02.811715 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:02.812330 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: 2ce8e836-308a-4cdb-8e70-a3d3b431da6d] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:02.812877 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-4162a4c2-ed72-4c4d-81f6-51ba10100dae tempest-TestShelveInstance-2128355205 tempest-TestShelveInstance-2128355205-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1852709330" status: 202 len: 0 microversion: 2.1 time: 0.051315 Nov 11 01:12:02.814580 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 653/1293] 10.222.0.52 () {58 vars in 1253 bytes} [Thu Nov 11 01:12:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1852709330 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:12:02.821901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.823134 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.824301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:02.824737 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:02.839761 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] HTTP exception thrown: Instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d could not be found. Nov 11 01:12:02.840349 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Returning 404 to user: Instance 2ce8e836-308a-4cdb-8e70-a3d3b431da6d could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:02.841168 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2c020cd5-1569-42df-bed5-061c016e35ff tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d" status: 404 len: 111 microversion: 2.1 time: 0.033040 Nov 11 01:12:02.841712 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 641/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:02 2021] GET /compute/v2.1/servers/2ce8e836-308a-4cdb-8e70-a3d3b431da6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 01:12:03.994125 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:03.994752 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:04.001880 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:04.002631 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:04.003459 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:04.004101 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:04.018839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] HTTP exception thrown: Instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 could not be found. Nov 11 01:12:04.019831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Returning 404 to user: Instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:04.020884 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0d171c62-bb6d-4281-b02d-db93babb58f3 tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 404 len: 111 microversion: 2.1 time: 0.030521 Nov 11 01:12:04.021768 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 654/1295] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:12:03 2021] DELETE /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:04.030689 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:04.031445 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] [instance: c4bc1ebf-6b32-496c-b7ff-a005abd1dec2] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:04.040769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:04.041478 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:04.042729 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:04.043458 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:04.061419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] HTTP exception thrown: Instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 could not be found. Nov 11 01:12:04.062327 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] Returning 404 to user: Instance c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:04.063533 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2c2dd735-cf67-46ba-a584-44fdac2804df tempest-AttachVolumeShelveTestJSON-964512944 tempest-AttachVolumeShelveTestJSON-964512944-project] 10.222.0.52 "GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2" status: 404 len: 111 microversion: 2.1 time: 0.036604 Nov 11 01:12:04.066911 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 642/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:04 2021] GET /compute/v2.1/servers/c4bc1ebf-6b32-496c-b7ff-a005abd1dec2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:07.234890 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-868662320"}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:07.236911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:07.250394 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:07.252102 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:07.253892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:07.254339 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:07.485352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.network.security_group_api [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Removing security group e539e8a8-1221-4448-baf2-b28c3821e1a7 from port c2076f3e-6040-4813-a257-8804dcab051f Nov 11 01:12:07.952156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9f4c9c96-246f-483f-bdb7-3f9e639b12ce tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/action" status: 202 len: 0 microversion: 2.1 time: 0.723964 Nov 11 01:12:07.952749 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 655/1297] 10.222.0.52 () {60 vars in 1277 bytes} [Thu Nov 11 01:12:07 2021] POST /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:12:07.973000 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-1eb46420-26a4-4af2-b54e-54855818d40a req-7ade4c0e-e149-492f-a394-ac20aaa72f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:07.975592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:12:07.975592 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:12:07.993711 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-1eb46420-26a4-4af2-b54e-54855818d40a req-7ade4c0e-e149-492f-a394-ac20aaa72f71 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:07.995856 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-1eb46420-26a4-4af2-b54e-54855818d40a req-7ade4c0e-e149-492f-a394-ac20aaa72f71 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:08.025851 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-1eb46420-26a4-4af2-b54e-54855818d40a req-7ade4c0e-e149-492f-a394-ac20aaa72f71 service nova] Creating event network-changed:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:12:08.034691 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-1eb46420-26a4-4af2-b54e-54855818d40a req-7ade4c0e-e149-492f-a394-ac20aaa72f71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065779 Nov 11 01:12:08.037466 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 643/1298] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:12:10.306845 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-be918d98-310a-49bb-860d-d65fe67096c5 req-933f7f49-aac4-47fe-9a6a-de00682d2225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:10.308248 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:10.310199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:12:10.310199 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:12:10.311314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:10.331966 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:10.332417 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:10.341200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-be918d98-310a-49bb-860d-d65fe67096c5 req-933f7f49-aac4-47fe-9a6a-de00682d2225 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:10.341652 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-be918d98-310a-49bb-860d-d65fe67096c5 req-933f7f49-aac4-47fe-9a6a-de00682d2225 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:10.344915 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:10.347151 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:10.368373 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-be918d98-310a-49bb-860d-d65fe67096c5 req-933f7f49-aac4-47fe-9a6a-de00682d2225 service nova] Creating event network-changed:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:12:10.374126 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-be918d98-310a-49bb-860d-d65fe67096c5 req-933f7f49-aac4-47fe-9a6a-de00682d2225 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079260 Nov 11 01:12:10.375552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 644/1299] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:12:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:12:10.529696 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lazy-loading 'services' on Instance uuid da015352-8fb0-4f06-bc78-c1cc0c9be5ca {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:12:10.700133 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d579ab2e-fc50-4636-8f7b-a22483f51a51 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments/b2c2c0c5-72d1-4f43-89f2-96a4f381f603" status: 202 len: 0 microversion: 2.1 time: 0.410619 Nov 11 01:12:10.702438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 656/1300] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:12:10 2021] DELETE /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments/b2c2c0c5-72d1-4f43-89f2-96a4f381f603 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:12:10.710421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:10.711552 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:10.740832 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:10.744744 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:10.745870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:10.748898 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:10.828067 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ebd6eb71-0457-41cf-8c70-a1601fce255e tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122001 Nov 11 01:12:10.829836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 645/1301] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:12:10 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:12:11.842377 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:11.843476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:11.851028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:11.851957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:11.852979 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:11.853662 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:11.902275 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-24fa9486-2527-494c-9517-2c50fdf9f03a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065007 Nov 11 01:12:11.903637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 657/1302] 10.222.0.52 () {58 vars in 1301 bytes} [Thu Nov 11 01:12:11 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 01:12:11.913254 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:11.914397 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:11.921056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:11.921859 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:11.922917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:11.923853 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:12.012768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] HTTP exception thrown: Instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca is not attached to volume b2c2c0c5-72d1-4f43-89f2-96a4f381f603 Nov 11 01:12:12.013317 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Returning 404 to user: Instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca is not attached to volume b2c2c0c5-72d1-4f43-89f2-96a4f381f603 {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:12.014139 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8afaa110-3f92-4bdc-96c7-6a941220c4d8 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments/b2c2c0c5-72d1-4f43-89f2-96a4f381f603" status: 404 len: 154 microversion: 2.1 time: 0.104775 Nov 11 01:12:12.014935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 646/1303] 10.222.0.52 () {58 vars in 1415 bytes} [Thu Nov 11 01:12:11 2021] DELETE /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca/os-volume_attachments/b2c2c0c5-72d1-4f43-89f2-96a4f381f603 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:13.213036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:13.214733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:13.222804 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:13.239162 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:13.240277 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:13.241221 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:13.284395 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Going to try to terminate instance {{(pid=116016) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:12:13.404003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-61304c9b-2c4f-44ec-a4d4-93f597200a35 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 204 len: 0 microversion: 2.1 time: 0.196910 Nov 11 01:12:13.405478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 658/1304] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:12:13 2021] DELETE /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:12:13.414633 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:13.415341 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:13.426735 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:13.427523 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:13.429426 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:13.430051 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:13.851740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:13.864366 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-86370af0-892b-4cee-b004-eb31b37b2fd4 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1555 microversion: 2.1 time: 0.454515 Nov 11 01:12:13.866900 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 647/1305] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:13 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1555 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:12:14.883549 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:14.884681 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:14.891193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:14.891830 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:14.893031 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:14.893658 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:15.044742 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:15.054438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-5af6f677-7e3e-43ab-8515-1940aeed97f2 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1555 microversion: 2.1 time: 0.175202 Nov 11 01:12:15.055508 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 659/1306] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:14 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:15.911295 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-17d93599-1218-40fb-8639-cc04ae25d3d4 req-e270457e-d4c1-4b3a-a9bc-c23bed9883f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da015352-8fb0-4f06-bc78-c1cc0c9be5ca", "name": "network-vif-deleted", "tag": "c2076f3e-6040-4813-a257-8804dcab051f"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:15.913125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:12:15.913125 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:12:15.928131 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-17d93599-1218-40fb-8639-cc04ae25d3d4 req-e270457e-d4c1-4b3a-a9bc-c23bed9883f1 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:15.928584 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-17d93599-1218-40fb-8639-cc04ae25d3d4 req-e270457e-d4c1-4b3a-a9bc-c23bed9883f1 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:15.941639 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-17d93599-1218-40fb-8639-cc04ae25d3d4 req-e270457e-d4c1-4b3a-a9bc-c23bed9883f1 service nova] Creating event network-vif-deleted:c2076f3e-6040-4813-a257-8804dcab051f for instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca on hv-cinder-81708 Nov 11 01:12:15.951137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-17d93599-1218-40fb-8639-cc04ae25d3d4 req-e270457e-d4c1-4b3a-a9bc-c23bed9883f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043675 Nov 11 01:12:15.951137 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 648/1307] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:12:16.072516 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:16.073982 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:16.085053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:16.086139 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:16.087863 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:16.088528 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:16.126477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:16.126859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:16.127356 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lazy-loading 'fault' on Instance uuid da015352-8fb0-4f06-bc78-c1cc0c9be5ca {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:12:16.173480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7179c255c5cf4dfca1ed17c80004dd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7abb9f19d954ab1b034c3bc7de8d24b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:16.183615 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-903168eb-86de-4bca-8a31-bc30100b5883 tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 200 len: 1348 microversion: 2.1 time: 0.115262 Nov 11 01:12:16.184480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 660/1308] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:16 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:12:17.201808 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:17.206924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] [instance: da015352-8fb0-4f06-bc78-c1cc0c9be5ca] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:17.223297 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:17.227505 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:17.229090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:17.229792 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:17.247776 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] HTTP exception thrown: Instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca could not be found. Nov 11 01:12:17.248394 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Returning 404 to user: Instance da015352-8fb0-4f06-bc78-c1cc0c9be5ca could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:12:17.249189 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-246ce7f9-b969-4e2c-bb0e-84234120b58a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca" status: 404 len: 111 microversion: 2.1 time: 0.051920 Nov 11 01:12:17.251079 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 649/1309] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:17 2021] GET /compute/v2.1/servers/da015352-8fb0-4f06-bc78-c1cc0c9be5ca => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:12:17.258194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0b5f4183-cae7-4077-8af6-c9056fd7d01a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] Calling method '.version_select at 0x7fd368226310>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:17.281469 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0b5f4183-cae7-4077-8af6-c9056fd7d01a tempest-TestMinimumBasicScenario-570509317 tempest-TestMinimumBasicScenario-570509317-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1630132196" status: 202 len: 0 microversion: 2.1 time: 0.026982 Nov 11 01:12:17.283173 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 661/1310] 10.222.0.52 () {58 vars in 1271 bytes} [Thu Nov 11 01:12:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1630132196 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 01:12:29.456626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-347da1ea-fdb5-49cc-af36-01be3bfb9108 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Action: 'create', calling method: .version_select at 0x7fd3640758b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1629511064"}} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:29.475161 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-347da1ea-fdb5-49cc-af36-01be3bfb9108 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for project 7768097cddbd4bfd856d852e06732b6d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:12:29.481987 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-347da1ea-fdb5-49cc-af36-01be3bfb9108 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for user 230522c86cb54917b908407ff521aab0 and project 7768097cddbd4bfd856d852e06732b6d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:12:29.952149 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-347da1ea-fdb5-49cc-af36-01be3bfb9108 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for project 7768097cddbd4bfd856d852e06732b6d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:12:29.956421 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.quota [None req-347da1ea-fdb5-49cc-af36-01be3bfb9108 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for user 230522c86cb54917b908407ff521aab0 and project 7768097cddbd4bfd856d852e06732b6d. Resources: {'key_pairs'} {{(pid=116015) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:12:29.973996 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-347da1ea-fdb5-49cc-af36-01be3bfb9108 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.830288 Nov 11 01:12:29.975514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 650/1311] 10.222.0.52 () {60 vars in 1157 bytes} [Thu Nov 11 01:12:29 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:37.335747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:12:37.336455 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:12:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:12:49.909412 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1144885428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629511064", "security_groups": [{"name": "tempest-secgroup-smoke-558106933"}], "block_device_mapping_v2": [{"uuid": "22e36023-0c0d-44d5-8e99-0109816b6174", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6faa490-5864-4152-980e-a0f56dce29f8"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:50.139659 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] validate_networks() for [('f6faa490-5864-4152-980e-a0f56dce29f8', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:12:50.528410 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:12:50.528841 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:12:50.529319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:12:50.529734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:12:50.530155 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:12:50.538903 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:50.540006 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:50.540936 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:50.541373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:50.558831 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for project 7768097cddbd4bfd856d852e06732b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:12:50.562820 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for user 230522c86cb54917b908407ff521aab0 and project 7768097cddbd4bfd856d852e06732b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:12:50.618909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:12:50.621070 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22e36023-0c0d-44d5-8e99-0109816b6174',volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:12:50.746111 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-cbb3c990-e418-4c4e-b5a7-d17ae4213679 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.841129 Nov 11 01:12:50.747156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 662/1312] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:12:49 2021] POST /compute/v2.1/servers => generated 405 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:12:50.760176 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-98a22818-4139-45b5-b5fa-8bcf30d2d648 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:50.761183 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-98a22818-4139-45b5-b5fa-8bcf30d2d648 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:50.921506 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-98a22818-4139-45b5-b5fa-8bcf30d2d648 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:50.928308 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-98a22818-4139-45b5-b5fa-8bcf30d2d648 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1095 microversion: 2.1 time: 0.174913 Nov 11 01:12:50.928987 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 651/1313] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:50 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1095 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:51.946053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:51.947180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:51.955136 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:51.956258 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:51.957251 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:51.958019 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:52.021779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:52.029987 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-577a48bb-398c-44b9-971b-d5c96246e8a1 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1211 microversion: 2.1 time: 0.088277 Nov 11 01:12:52.030641 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 663/1314] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:51 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:53.046688 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:53.048028 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:53.054822 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:53.055302 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:53.056828 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:53.057303 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:53.179403 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-a8261bcb-ccfe-4a7c-a7bb-f46de7107e0c req-44285644-c87e-4116-afe5-c96f5ec04670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f7b672-d2b8-4b4a-afae-27badff30668", "tag": "155d9f91-26a8-463a-be2a-e6d0dc5d9a04"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:12:53.181609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:12:53.181609 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:12:53.190068 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-a8261bcb-ccfe-4a7c-a7bb-f46de7107e0c req-44285644-c87e-4116-afe5-c96f5ec04670 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:53.190790 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-a8261bcb-ccfe-4a7c-a7bb-f46de7107e0c req-44285644-c87e-4116-afe5-c96f5ec04670 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:53.208398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-a8261bcb-ccfe-4a7c-a7bb-f46de7107e0c req-44285644-c87e-4116-afe5-c96f5ec04670 service nova] Creating event network-changed:155d9f91-26a8-463a-be2a-e6d0dc5d9a04 for instance b6f7b672-d2b8-4b4a-afae-27badff30668 on hv-cinder-81708 Nov 11 01:12:53.215984 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-a8261bcb-ccfe-4a7c-a7bb-f46de7107e0c req-44285644-c87e-4116-afe5-c96f5ec04670 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039974 Nov 11 01:12:53.216807 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 664/1315] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:12:53.230096 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:53.237801 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4e0fc654-c462-4699-88df-1e1e8b279426 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.194771 Nov 11 01:12:53.238380 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 652/1316] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:53 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:54.256429 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:54.257135 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:54.263945 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:54.264398 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:54.265176 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:54.265613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:54.402388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:54.409843 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-7a1f2642-9cbf-4dcc-96bd-18f83546b8d3 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.158056 Nov 11 01:12:54.410416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 665/1317] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:54 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:55.426672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:55.427434 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:55.434320 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:55.434765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:55.435569 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:55.435997 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:55.573202 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:55.580364 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8f87faaa-cb54-418c-8c8a-414e8b807eb7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.157289 Nov 11 01:12:55.580933 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 653/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:55 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:56.598052 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:56.598657 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:56.605371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:56.605812 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:56.606583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:56.607040 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:56.743869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:56.752051 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-fdfedee4-0a89-4028-8cad-d79020f03609 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.157639 Nov 11 01:12:56.752611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 666/1319] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:56 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:57.769276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:57.769826 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:57.776626 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:57.777079 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:57.777865 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:57.778302 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:57.909508 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:57.917200 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8951b4ac-2ae8-487d-825f-3472b6b046da tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.151685 Nov 11 01:12:57.917766 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 654/1320] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:57 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:12:58.933918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:12:58.934524 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:12:58.940734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:58.941175 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:58.941937 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:12:58.942366 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:12:59.070558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:12:59.078444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-91526757-36d3-41af-93e4-f0bceac53cd5 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.148713 Nov 11 01:12:59.079020 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 667/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:12:58 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:00.095009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:00.095621 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:00.101976 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:00.102440 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:00.103257 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:00.103694 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:00.243234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:00.251171 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3c5cf8c9-df3f-4491-92f2-8eb2cf68316c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.159892 Nov 11 01:13:00.251742 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 655/1322] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:00 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:01.271776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:01.272390 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:01.279399 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:01.279845 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:01.280630 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:01.281056 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:01.423921 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:01.431271 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-be35ecdb-2824-4bf5-84cf-e67ab381e6bc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.163201 Nov 11 01:13:01.432274 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 668/1323] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:01 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:02.448234 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:02.448816 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:02.455024 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:02.455469 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:02.456231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:02.456658 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:02.587514 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:02.595333 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cf23a198-4f3b-48fd-a960-62f1c2d28b89 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.151023 Nov 11 01:13:02.595895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 656/1324] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:02 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:03.612616 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:03.613242 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:03.620142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:03.620583 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:03.621352 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:03.621777 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:03.757601 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:03.765781 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-bf853c40-c9d4-4067-b520-6de54008f686 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.156886 Nov 11 01:13:03.766359 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 669/1325] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:03 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:04.783135 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:04.784447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:04.792090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:04.792538 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:04.793326 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:04.793765 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:04.929687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:04.937693 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-d5f6d10e-756d-42a2-b2bf-55e8527457b7 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.158297 Nov 11 01:13:04.938364 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 657/1326] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:04 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:04.939952 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-15b82629-ce25-43c9-b029-9c16953b45c0 req-4048654b-93b4-4b59-bd83-c0bee2cc03bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f7b672-d2b8-4b4a-afae-27badff30668", "name": "network-vif-plugged", "status": "completed", "tag": "155d9f91-26a8-463a-be2a-e6d0dc5d9a04"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:13:04.941462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:13:04.941462 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:13:04.949500 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-15b82629-ce25-43c9-b029-9c16953b45c0 req-4048654b-93b4-4b59-bd83-c0bee2cc03bf service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:04.950325 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-15b82629-ce25-43c9-b029-9c16953b45c0 req-4048654b-93b4-4b59-bd83-c0bee2cc03bf service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:04.965329 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-15b82629-ce25-43c9-b029-9c16953b45c0 req-4048654b-93b4-4b59-bd83-c0bee2cc03bf service nova] Creating event network-vif-plugged:155d9f91-26a8-463a-be2a-e6d0dc5d9a04 for instance b6f7b672-d2b8-4b4a-afae-27badff30668 on hv-cinder-81708 Nov 11 01:13:04.970534 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-15b82629-ce25-43c9-b029-9c16953b45c0 req-4048654b-93b4-4b59-bd83-c0bee2cc03bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Nov 11 01:13:04.971321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 670/1327] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:13:05.955617 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:05.956232 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:05.963336 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:05.963789 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:05.964842 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:05.965276 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:06.105893 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:06.115399 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-97b22bae-2b4f-4d94-8c44-35551432018d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1266 microversion: 2.1 time: 0.163529 Nov 11 01:13:06.115978 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 658/1328] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:05 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:07.132978 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:07.133714 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:07.140330 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:07.140778 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:07.141560 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:07.141994 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:07.277382 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:07.284798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-87818e0a-fbbc-49ba-bf8c-caff41975482 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1454 microversion: 2.1 time: 0.155971 Nov 11 01:13:07.285371 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 671/1329] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:07 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:07.301527 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:13:07.302130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:13:07.309015 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:07.309706 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:07.310496 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:07.310924 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:07.448586 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:13:07.455854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-24b5bded-a177-46d2-9934-958acd527c54 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1454 microversion: 2.1 time: 0.157882 Nov 11 01:13:07.456417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 659/1330] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:13:07 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:13:09.329314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-0605a9f8-ffa4-490a-8bcb-9e5c446ce1bb req-0dba333f-5ab3-43b3-a3b9-852fb81906c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f7b672-d2b8-4b4a-afae-27badff30668", "tag": "155d9f91-26a8-463a-be2a-e6d0dc5d9a04"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:13:09.330881 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:13:09.330881 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:13:09.338519 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-0605a9f8-ffa4-490a-8bcb-9e5c446ce1bb req-0dba333f-5ab3-43b3-a3b9-852fb81906c1 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:13:09.339028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-0605a9f8-ffa4-490a-8bcb-9e5c446ce1bb req-0dba333f-5ab3-43b3-a3b9-852fb81906c1 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:13:09.350003 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-0605a9f8-ffa4-490a-8bcb-9e5c446ce1bb req-0dba333f-5ab3-43b3-a3b9-852fb81906c1 service nova] Creating event network-changed:155d9f91-26a8-463a-be2a-e6d0dc5d9a04 for instance b6f7b672-d2b8-4b4a-afae-27badff30668 on hv-cinder-81708 Nov 11 01:13:09.356815 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-0605a9f8-ffa4-490a-8bcb-9e5c446ce1bb req-0dba333f-5ab3-43b3-a3b9-852fb81906c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031609 Nov 11 01:13:09.357725 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 672/1331] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:15:14.190220 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:14.190811 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:14.197206 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:14.197654 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:14.198425 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:14.198850 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:14.222901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:15:14.295767 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5b140341-e612-43ed-87f5-d41074293a4b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 204 len: 0 microversion: 2.1 time: 0.109955 Nov 11 01:15:14.296357 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 660/1332] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:15:14 2021] DELETE /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:15:14.303873 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c3a46b3-f1d2-4e89-8aac-d579bd549ffa] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 11 01:15:14.307779 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:14.308474 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:14.314501 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:14.314967 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:14.315775 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:14.316232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:14.449666 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:14.456911 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-03d491a2-7b89-4b97-9fbc-1e32f5539abd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1577 microversion: 2.1 time: 0.155905 Nov 11 01:15:14.458308 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 673/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:14 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:15.475275 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:15.475965 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:15.482231 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:15.482674 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:15.483465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:15.483894 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:15.628186 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:15.635685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-093d752e-a237-4fc3-9cbb-73b09fa4cd06 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1577 microversion: 2.1 time: 0.164622 Nov 11 01:15:15.636264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 661/1334] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:15 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:16.652245 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:16.652849 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:16.670387 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:16.670833 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:16.671672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:16.672102 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:16.678369 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c3a46b3-f1d2-4e89-8aac-d579bd549ffa] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39804. Nov 11 01:15:16.819472 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:16.826829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-34b91366-27e5-4059-ac79-96a436753d02 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1577 microversion: 2.1 time: 0.178315 Nov 11 01:15:16.827428 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 674/1335] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:16 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:17.351065 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-6145bb72-9e6e-4b36-9d4f-4af6ea283ab5 req-01ade6b2-4da8-4b39-abbf-127ecccd3c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f7b672-d2b8-4b4a-afae-27badff30668", "name": "network-vif-deleted", "tag": "155d9f91-26a8-463a-be2a-e6d0dc5d9a04"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:15:17.353297 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:15:17.353297 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:15:17.360515 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-6145bb72-9e6e-4b36-9d4f-4af6ea283ab5 req-01ade6b2-4da8-4b39-abbf-127ecccd3c01 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:17.361026 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-6145bb72-9e6e-4b36-9d4f-4af6ea283ab5 req-01ade6b2-4da8-4b39-abbf-127ecccd3c01 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:17.533400 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-6145bb72-9e6e-4b36-9d4f-4af6ea283ab5 req-01ade6b2-4da8-4b39-abbf-127ecccd3c01 service nova] Creating event network-vif-deleted:155d9f91-26a8-463a-be2a-e6d0dc5d9a04 for instance b6f7b672-d2b8-4b4a-afae-27badff30668 on hv-cinder-81708 Nov 11 01:15:17.539468 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-6145bb72-9e6e-4b36-9d4f-4af6ea283ab5 req-01ade6b2-4da8-4b39-abbf-127ecccd3c01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381675 Nov 11 01:15:17.540379 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 662/1336] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:15:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:15:17.845072 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:17.845685 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:17.852747 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:17.853193 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:17.853957 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:17.854383 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:17.887998 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:17.888438 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:17.888940 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.objects.instance [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lazy-loading 'fault' on Instance uuid b6f7b672-d2b8-4b4a-afae-27badff30668 {{(pid=116016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 01:15:17.936470 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:17.945868 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-35663a36-95ad-4914-a51f-75c17de392d0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 200 len: 1231 microversion: 2.1 time: 0.104429 Nov 11 01:15:17.954084 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 675/1337] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:17 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 1231 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:18.964307 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:18.965014 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:18.971983 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:18.972427 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:18.973869 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:18.974264 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:18.986872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] HTTP exception thrown: Instance b6f7b672-d2b8-4b4a-afae-27badff30668 could not be found. Nov 11 01:15:18.987475 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Returning 404 to user: Instance b6f7b672-d2b8-4b4a-afae-27badff30668 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:15:18.988282 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-95f3ba0c-b71c-4893-abc4-339558c85085 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 404 len: 111 microversion: 2.1 time: 0.028475 Nov 11 01:15:18.988932 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 663/1338] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:18 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:15:19.088550 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-287196161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629511064", "security_groups": [{"name": "tempest-secgroup-smoke-558106933"}], "block_device_mapping_v2": [{"uuid": "22e36023-0c0d-44d5-8e99-0109816b6174", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6faa490-5864-4152-980e-a0f56dce29f8"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:15:19.196426 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] validate_networks() for [('f6faa490-5864-4152-980e-a0f56dce29f8', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:15:19.649463 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:15:19.649876 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:15:19.650343 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:15:19.650745 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:15:19.651182 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:15:19.659589 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:19.660028 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:19.661200 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:19.661635 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:19.678597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for project 7768097cddbd4bfd856d852e06732b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:15:19.682416 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for user 230522c86cb54917b908407ff521aab0 and project 7768097cddbd4bfd856d852e06732b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:15:19.736142 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:15:19.738273 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22e36023-0c0d-44d5-8e99-0109816b6174',volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:15:19.857836 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-73b17c51-1038-4e4a-8bf3-bce68ad36c10 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772932 Nov 11 01:15:19.858475 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 676/1339] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:15:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:15:19.868815 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-cff841bf-8c15-4c08-a7ce-d53e417eff9d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:19.869450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-cff841bf-8c15-4c08-a7ce-d53e417eff9d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:19.921011 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-cff841bf-8c15-4c08-a7ce-d53e417eff9d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:19.928146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-cff841bf-8c15-4c08-a7ce-d53e417eff9d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1094 microversion: 2.1 time: 0.063044 Nov 11 01:15:19.928696 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 664/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:19 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:20.945280 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d182aa78-8620-4e08-8aef-5c2975b331a9 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:20.945890 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d182aa78-8620-4e08-8aef-5c2975b331a9 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:21.000388 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d182aa78-8620-4e08-8aef-5c2975b331a9 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:21.007832 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d182aa78-8620-4e08-8aef-5c2975b331a9 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1094 microversion: 2.1 time: 0.066677 Nov 11 01:15:21.008392 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 677/1341] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:20 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:22.024820 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b4d1bd82-a086-4fd3-b984-f427852e1b92 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:22.025423 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b4d1bd82-a086-4fd3-b984-f427852e1b92 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:22.077854 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-b4d1bd82-a086-4fd3-b984-f427852e1b92 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:22.084946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b4d1bd82-a086-4fd3-b984-f427852e1b92 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1094 microversion: 2.1 time: 0.063858 Nov 11 01:15:22.085686 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 665/1342] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:22 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:23.101457 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9e8cb218-2617-4b74-a2cf-d13f816db0f4 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:23.102067 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9e8cb218-2617-4b74-a2cf-d13f816db0f4 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:23.156578 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9e8cb218-2617-4b74-a2cf-d13f816db0f4 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:23.163270 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9e8cb218-2617-4b74-a2cf-d13f816db0f4 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1094 microversion: 2.1 time: 0.065482 Nov 11 01:15:23.163832 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 678/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:23 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:15:24.180439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:24.181042 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:24.186899 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:24.187374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:24.188144 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:24.188571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:24.246594 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:24.253685 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8d7c14ab-4185-4a0f-ace0-68e6c879fe9b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1144 microversion: 2.1 time: 0.077686 Nov 11 01:15:24.254870 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 666/1344] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:24 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:25.271054 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:25.271607 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:25.278358 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:25.278813 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:25.279620 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:25.280053 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:25.339916 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:25.347867 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-9e5f081d-6b4d-4845-a465-304cc5b1a16b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1210 microversion: 2.1 time: 0.081220 Nov 11 01:15:25.348924 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 679/1345] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:25 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:26.342803 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-18a0807a-92c6-4169-81af-f281943adaf0 req-fb033954-8029-456e-b208-265fc36ac164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78ccef4-9081-4590-b094-3b8cbd532a07", "tag": "c47d9952-985e-44f1-829a-36e30c6284d3"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:15:26.344945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:15:26.344945 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:15:26.353739 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-18a0807a-92c6-4169-81af-f281943adaf0 req-fb033954-8029-456e-b208-265fc36ac164 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:26.354424 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-18a0807a-92c6-4169-81af-f281943adaf0 req-fb033954-8029-456e-b208-265fc36ac164 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:26.366817 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-18a0807a-92c6-4169-81af-f281943adaf0 req-fb033954-8029-456e-b208-265fc36ac164 service nova] Creating event network-changed:c47d9952-985e-44f1-829a-36e30c6284d3 for instance e78ccef4-9081-4590-b094-3b8cbd532a07 on hv-cinder-81708 Nov 11 01:15:26.369806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:26.370632 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:26.378731 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-18a0807a-92c6-4169-81af-f281943adaf0 req-fb033954-8029-456e-b208-265fc36ac164 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039572 Nov 11 01:15:26.381002 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 667/1346] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:15:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:15:26.383239 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:26.383859 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:26.386433 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:26.386879 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:26.533345 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:26.540947 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-206ed147-63ed-41a8-b7b0-3fb9672cd9ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.175525 Nov 11 01:15:26.541515 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 680/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:26 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:27.558747 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:27.559467 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:27.565453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:27.565893 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:27.567217 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:27.567833 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:27.702618 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:27.710571 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-385e6431-7975-45a1-baad-0d0faabfff29 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.156281 Nov 11 01:15:27.711154 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 668/1348] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:27 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:28.691706 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:15:28.692312 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: Thu Nov 11 01:15:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:15:28.727571 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:28.728180 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:28.734367 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:28.734814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:28.735633 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:28.736068 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:28.866192 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:28.873413 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-528ad20d-214d-4589-8578-7618df4ab4fe tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.149471 Nov 11 01:15:28.873973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 681/1349] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:28 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:29.890133 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:29.890749 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:29.897653 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:29.898100 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:29.898906 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:29.899359 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:30.032500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:30.040105 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e8bda2c7-6a1e-40f6-99d8-a48d3c315a0d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.153670 Nov 11 01:15:30.040664 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 669/1350] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:29 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:31.056532 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:31.057146 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:31.063440 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:31.063891 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:31.064672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:31.065111 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:31.194488 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:31.201729 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1611aa75-a352-47d3-b23e-ba592489ee6d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.148849 Nov 11 01:15:31.202289 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 682/1351] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:31 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:32.219687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:32.220258 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:32.226741 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:32.227226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:32.228008 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:32.228441 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:32.363286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:32.370616 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-0b7244a8-bd81-43ba-bbeb-0f6a29dcc33a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.154893 Nov 11 01:15:32.371248 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 670/1352] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:32 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:33.387694 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:33.388302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:33.394434 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:33.395116 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:33.395798 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:33.396227 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:33.537171 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:33.544302 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d2182aab-0e6a-47a2-8c5a-b965b91273a0 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.160316 Nov 11 01:15:33.544866 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 683/1353] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:33 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:34.560946 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:34.561550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:34.568753 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:34.569191 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:34.569956 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:34.570382 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:34.703829 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:34.711855 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-979391c2-5833-42a6-8a58-e19bbc3bda5f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.154611 Nov 11 01:15:34.712411 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 671/1354] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:34 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:35.728115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:35.728731 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:35.734856 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:35.735338 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:35.736146 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:35.736591 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:35.867533 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:35.874688 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a81adabe-645d-43cb-b123-83d037bd073e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.150268 Nov 11 01:15:35.875317 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 684/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:35 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:36.892340 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:36.892919 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:36.900174 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:36.900607 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:36.901367 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:36.901794 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:37.029721 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:37.036930 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-fbc78f80-07c9-4952-9b5d-23e64b078b84 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.148259 Nov 11 01:15:37.037481 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 672/1356] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:36 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:37.914212 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-606ba28f-0fd1-4705-8cc1-016137b47593 req-6c44813b-b675-4660-816a-023d343e112f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78ccef4-9081-4590-b094-3b8cbd532a07", "name": "network-vif-plugged", "status": "completed", "tag": "c47d9952-985e-44f1-829a-36e30c6284d3"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:15:37.915954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:15:37.915954 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:15:37.922490 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-606ba28f-0fd1-4705-8cc1-016137b47593 req-6c44813b-b675-4660-816a-023d343e112f service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:37.922932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-606ba28f-0fd1-4705-8cc1-016137b47593 req-6c44813b-b675-4660-816a-023d343e112f service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:37.933886 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-606ba28f-0fd1-4705-8cc1-016137b47593 req-6c44813b-b675-4660-816a-023d343e112f service nova] Creating event network-vif-plugged:c47d9952-985e-44f1-829a-36e30c6284d3 for instance e78ccef4-9081-4590-b094-3b8cbd532a07 on hv-cinder-81708 Nov 11 01:15:37.938897 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-606ba28f-0fd1-4705-8cc1-016137b47593 req-6c44813b-b675-4660-816a-023d343e112f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138348 Nov 11 01:15:37.939491 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 685/1357] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:15:38.052943 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:38.053466 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:38.060417 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:38.060868 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:38.061647 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:38.062077 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:38.203827 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:38.213690 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-dbcaaaed-c440-44cc-a4c0-e5d8a3d1dbcd tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.164220 Nov 11 01:15:38.214350 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 673/1358] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:38 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:39.231829 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:39.232443 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:39.238269 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:39.238718 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:39.240059 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:39.240899 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:39.381025 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:39.388231 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f81ad015-c181-40d8-b9b6-35d7c18ea08a tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1265 microversion: 2.1 time: 0.160976 Nov 11 01:15:39.388789 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 686/1359] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:39 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:40.404675 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:40.405335 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:40.411630 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:40.412073 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:40.412836 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:40.413263 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:40.547157 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:40.554542 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8a175fa3-a9e1-41a0-a9a9-289569e8409e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1452 microversion: 2.1 time: 0.153473 Nov 11 01:15:40.555138 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 674/1360] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:40 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:40.570795 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:15:40.571435 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:15:40.577851 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:40.578304 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:40.579118 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:40.579556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:40.709613 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:15:40.717156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a24bf228-c5d6-45d8-aeef-643396d2de5d tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1452 microversion: 2.1 time: 0.150585 Nov 11 01:15:40.717806 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 687/1361] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:15:40 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:15:42.657896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [req-c849a85f-a56f-4fd6-9466-1658bb736af1 req-703a9e60-7a57-43df-a8ef-0b904142d79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78ccef4-9081-4590-b094-3b8cbd532a07", "tag": "c47d9952-985e-44f1-829a-36e30c6284d3"}]} {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:15:42.659452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:15:42.659452 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: warnings.warn(msg) Nov 11 01:15:42.666351 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-c849a85f-a56f-4fd6-9466-1658bb736af1 req-703a9e60-7a57-43df-a8ef-0b904142d79b service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:15:42.666872 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [req-c849a85f-a56f-4fd6-9466-1658bb736af1 req-703a9e60-7a57-43df-a8ef-0b904142d79b service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:15:42.677660 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.compute.server_external_events [req-c849a85f-a56f-4fd6-9466-1658bb736af1 req-703a9e60-7a57-43df-a8ef-0b904142d79b service nova] Creating event network-changed:c47d9952-985e-44f1-829a-36e30c6284d3 for instance e78ccef4-9081-4590-b094-3b8cbd532a07 on hv-cinder-81708 Nov 11 01:15:42.682895 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [req-c849a85f-a56f-4fd6-9466-1658bb736af1 req-703a9e60-7a57-43df-a8ef-0b904142d79b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138781 Nov 11 01:15:42.683622 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 675/1362] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:15:57.355628 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:15:57.356255 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:15:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:17:18.531989 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-780401193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629511064", "security_groups": [{"name": "tempest-secgroup-smoke-558106933"}], "block_device_mapping_v2": [{"uuid": "90a9a4fe-9f13-4c7c-8f81-8ece5afac6a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6faa490-5864-4152-980e-a0f56dce29f8"}]}} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:17:18.642796 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.network.neutron [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] validate_networks() for [('f6faa490-5864-4152-980e-a0f56dce29f8', None, None, None, None, None)] {{(pid=116016) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 01:17:19.016881 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Flavor limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 01:17:19.017347 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Image limits 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 01:17:19.017797 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Flavor pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 01:17:19.018199 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Image pref 0:0:0 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 01:17:19.018603 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.virt.hardware [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 01:17:19.028022 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:19.028506 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:19.029348 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:19.029814 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:19.046649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for project 7768097cddbd4bfd856d852e06732b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 01:17:19.050476 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.quota [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Getting quotas for user 230522c86cb54917b908407ff521aab0 and project 7768097cddbd4bfd856d852e06732b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=116016) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 01:17:19.105036 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Going to run 1 instances... {{(pid=116016) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 01:17:19.107169 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90a9a4fe-9f13-4c7c-8f81-8ece5afac6a1',volume_size=None,volume_type=None)] {{(pid=116016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 01:17:19.227041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ee583b4e-d5cf-43f0-9a92-9a6578883b3c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699703 Nov 11 01:17:19.227680 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 688/1363] 10.222.0.52 () {60 vars in 1146 bytes} [Thu Nov 11 01:17:18 2021] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 01:17:19.239074 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-1c6068bc-1f48-4956-9a06-df418551dd11 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:19.239768 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-1c6068bc-1f48-4956-9a06-df418551dd11 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:19.295573 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-1c6068bc-1f48-4956-9a06-df418551dd11 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:19.301947 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-1c6068bc-1f48-4956-9a06-df418551dd11 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1094 microversion: 2.1 time: 0.067826 Nov 11 01:17:19.302498 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 676/1364] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:19 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:20.320047 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:20.320649 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:20.327389 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:20.327825 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:20.328709 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:20.329148 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:20.391518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:20.398973 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d0530783-1cff-45c1-b3e4-032ef6545c8e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1210 microversion: 2.1 time: 0.083324 Nov 11 01:17:20.399547 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 689/1365] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:20 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:21.416823 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:21.418280 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:21.425719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:21.426170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:21.426981 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:21.427419 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:21.594516 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:21.602450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bdb9197e-81af-41cf-8733-d7fe9ae610cb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.190075 Nov 11 01:17:21.603043 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 677/1366] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:21 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:21.644520 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-5336f0d4-0a68-43f7-9909-247f8954f4d3 req-bba6674c-2f84-4a0d-bda1-3a712716c1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465ec313-e2c3-4a5d-a27e-2916b894353f", "tag": "02102235-a784-476e-808f-741130b4cc22"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:17:21.646149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:17:21.646149 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:17:21.658276 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5336f0d4-0a68-43f7-9909-247f8954f4d3 req-bba6674c-2f84-4a0d-bda1-3a712716c1cf service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:21.658810 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-5336f0d4-0a68-43f7-9909-247f8954f4d3 req-bba6674c-2f84-4a0d-bda1-3a712716c1cf service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:21.672626 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-5336f0d4-0a68-43f7-9909-247f8954f4d3 req-bba6674c-2f84-4a0d-bda1-3a712716c1cf service nova] Creating event network-changed:02102235-a784-476e-808f-741130b4cc22 for instance 465ec313-e2c3-4a5d-a27e-2916b894353f on hv-cinder-81708 Nov 11 01:17:21.677546 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-5336f0d4-0a68-43f7-9909-247f8954f4d3 req-bba6674c-2f84-4a0d-bda1-3a712716c1cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036800 Nov 11 01:17:21.678295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 690/1367] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:17:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:17:22.620699 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:22.621239 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:22.627529 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:22.628097 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:22.628962 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:22.629435 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:22.768698 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:22.775985 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5b5b558f-2095-4e43-86ac-79073e5b7daf tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.159973 Nov 11 01:17:22.776563 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 678/1368] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:22 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:17:23.794600 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:23.795319 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:23.801298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:23.801733 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:23.802494 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:23.802918 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:23.951896 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:23.959373 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-d19c83f8-2dfa-4c6f-ae09-a9568a71ab23 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.169672 Nov 11 01:17:23.959983 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 691/1369] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:23 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:17:24.976443 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:24.977062 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:24.983451 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:24.983896 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:24.984672 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:24.985103 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:25.123797 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:25.131078 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-5f524577-4cc5-4040-b509-8dd546f216cc tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.158293 Nov 11 01:17:25.131634 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 679/1370] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:24 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:26.148314 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:26.148926 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:26.155419 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:26.155870 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:26.156646 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:26.157081 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:26.285963 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:26.293808 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-ad5c183e-4a35-4c25-8bc3-4eb8220344ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.149196 Nov 11 01:17:26.294374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 692/1371] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:26 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:27.309386 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:27.309991 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:27.316170 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:27.316615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:27.317378 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:27.317805 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:27.454615 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:27.462146 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2534e643-ea49-4fe5-9b35-5fb3a5fa2beb tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.156399 Nov 11 01:17:27.462717 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 680/1372] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:27 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:28.548661 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:28.549279 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:28.555024 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:28.555478 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:28.556254 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:28.556783 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:28.687344 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:28.694480 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-08c9a6dd-df8f-4e18-8dc0-a991d56b5d88 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.217751 Nov 11 01:17:28.695077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 693/1373] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:28 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:29.711960 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:29.712537 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:29.719226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:29.719671 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:29.720439 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:29.720866 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:29.877953 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:29.885500 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2f34f1b8-248d-4913-8b83-96a427674b05 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.177299 Nov 11 01:17:29.886984 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 681/1374] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:29 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:30.904287 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:30.905071 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:30.913263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:30.913703 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:30.914482 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:30.914909 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:31.052144 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:31.060050 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-2ad95faa-de41-4515-a790-fa54efc67f3e tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.160812 Nov 11 01:17:31.060611 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 694/1375] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:30 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:32.077447 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:32.078051 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:32.084286 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:32.084682 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:32.085424 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:32.085849 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:32.217193 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:32.224738 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ddb11e60-4f73-4194-bf21-cd77ff681951 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.151922 Nov 11 01:17:32.225300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 682/1376] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:32 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:32.312894 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-0d250b7a-35b9-4779-b698-44ffb8eb218c req-4e1e673f-e442-4e19-a636-68e183c384d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ec313-e2c3-4a5d-a27e-2916b894353f", "name": "network-vif-plugged", "status": "completed", "tag": "02102235-a784-476e-808f-741130b4cc22"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:17:32.314446 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:17:32.314446 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:17:32.322272 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-0d250b7a-35b9-4779-b698-44ffb8eb218c req-4e1e673f-e442-4e19-a636-68e183c384d9 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:32.322900 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-0d250b7a-35b9-4779-b698-44ffb8eb218c req-4e1e673f-e442-4e19-a636-68e183c384d9 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:32.335776 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-0d250b7a-35b9-4779-b698-44ffb8eb218c req-4e1e673f-e442-4e19-a636-68e183c384d9 service nova] Creating event network-vif-plugged:02102235-a784-476e-808f-741130b4cc22 for instance 465ec313-e2c3-4a5d-a27e-2916b894353f on hv-cinder-81708 Nov 11 01:17:32.340624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-0d250b7a-35b9-4779-b698-44ffb8eb218c req-4e1e673f-e442-4e19-a636-68e183c384d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032563 Nov 11 01:17:32.341214 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 695/1377] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:17:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:17:33.242433 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:33.243030 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:33.249300 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:33.249742 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:33.250511 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:33.250935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:33.384480 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:33.392230 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-ad467198-5b33-4f89-ae01-4f70445964ca tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1265 microversion: 2.1 time: 0.153582 Nov 11 01:17:33.392783 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 683/1378] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:33 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:34.410712 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:34.411402 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:34.418621 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:34.419096 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:34.419866 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:34.420295 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:34.552950 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:34.561637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-f9639bc6-e03c-496a-9c52-05a287453b99 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1452 microversion: 2.1 time: 0.155377 Nov 11 01:17:34.562232 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 696/1379] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:34 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:34.577839 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:17:34.578460 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:17:34.584687 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:34.585135 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:34.585913 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:34.586352 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:34.718609 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:17:34.725907 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-3e853a7a-0b69-4178-b906-e8cdd7367493 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1452 microversion: 2.1 time: 0.152313 Nov 11 01:17:34.726471 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 684/1380] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:17:34 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:17:36.313064 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-6d6e7c47-f553-4c89-a56e-23be572a4e24 req-df9804df-c007-4fc0-9cf1-9467239adcfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465ec313-e2c3-4a5d-a27e-2916b894353f", "tag": "02102235-a784-476e-808f-741130b4cc22"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:17:36.314556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:17:36.314556 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:17:36.321753 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-6d6e7c47-f553-4c89-a56e-23be572a4e24 req-df9804df-c007-4fc0-9cf1-9467239adcfb service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:17:36.322194 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-6d6e7c47-f553-4c89-a56e-23be572a4e24 req-df9804df-c007-4fc0-9cf1-9467239adcfb service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:17:36.333687 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-6d6e7c47-f553-4c89-a56e-23be572a4e24 req-df9804df-c007-4fc0-9cf1-9467239adcfb service nova] Creating event network-changed:02102235-a784-476e-808f-741130b4cc22 for instance 465ec313-e2c3-4a5d-a27e-2916b894353f on hv-cinder-81708 Nov 11 01:17:36.338450 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-6d6e7c47-f553-4c89-a56e-23be572a4e24 req-df9804df-c007-4fc0-9cf1-9467239adcfb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028943 Nov 11 01:17:36.339597 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 697/1381] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:17:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:17:46.191463 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:17:46.192056 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:17:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:17:57.336528 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:17:57.337205 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:17:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:18:48.709542 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:18:48.710174 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: Thu Nov 11 01:18:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:19:16.299130 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:16.300198 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:16.303257 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-2838dcba-059c-4483-ae4b-a68d9d750d52 req-85a3b0e6-dc93-4947-82d9-d2688ad37808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465ec313-e2c3-4a5d-a27e-2916b894353f", "tag": "02102235-a784-476e-808f-741130b4cc22"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:19:16.304970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:19:16.304970 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:19:16.306769 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:16.307374 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:16.308407 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:16.309054 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:16.312483 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-2838dcba-059c-4483-ae4b-a68d9d750d52 req-85a3b0e6-dc93-4947-82d9-d2688ad37808 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:16.313001 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-2838dcba-059c-4483-ae4b-a68d9d750d52 req-85a3b0e6-dc93-4947-82d9-d2688ad37808 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:16.324044 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-2838dcba-059c-4483-ae4b-a68d9d750d52 req-85a3b0e6-dc93-4947-82d9-d2688ad37808 service nova] Creating event network-changed:02102235-a784-476e-808f-741130b4cc22 for instance 465ec313-e2c3-4a5d-a27e-2916b894353f on hv-cinder-81708 Nov 11 01:19:16.329170 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-2838dcba-059c-4483-ae4b-a68d9d750d52 req-85a3b0e6-dc93-4947-82d9-d2688ad37808 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Nov 11 01:19:16.329758 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 698/1382] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:19:16.335053 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:19:16.416845 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-8e883dce-4652-42f2-a6d1-b714cad57581 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 204 len: 0 microversion: 2.1 time: 0.121872 Nov 11 01:19:16.420667 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 685/1383] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:19:16 2021] DELETE /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:19:16.428839 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:16.429895 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:16.436637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:16.437087 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:16.438057 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:16.438498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:16.653564 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:19:16.661156 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-1eaf3760-3bb1-4388-ab49-845563460597 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1576 microversion: 2.1 time: 0.238898 Nov 11 01:19:16.661948 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 699/1384] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:16 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:19:17.373349 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:19:17.373830 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:19:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:19:17.680564 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:17.681948 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:17.688213 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:17.688673 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:17.689450 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:17.689888 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:17.873274 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:19:17.882279 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-4b875fbb-2783-4489-9b41-f6de68f8bdb6 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1458 microversion: 2.1 time: 0.205740 Nov 11 01:19:17.882852 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 686/1385] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:17 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:19:18.621497 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-d45ab4b8-da8d-4785-bc61-028be45e7726 req-14d5f8f0-f85d-42a0-9643-03cc534a047e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ec313-e2c3-4a5d-a27e-2916b894353f", "name": "network-vif-deleted", "tag": "02102235-a784-476e-808f-741130b4cc22"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:19:18.623544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:19:18.623544 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:19:18.631848 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d45ab4b8-da8d-4785-bc61-028be45e7726 req-14d5f8f0-f85d-42a0-9643-03cc534a047e service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:18.632298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-d45ab4b8-da8d-4785-bc61-028be45e7726 req-14d5f8f0-f85d-42a0-9643-03cc534a047e service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:18.643354 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-d45ab4b8-da8d-4785-bc61-028be45e7726 req-14d5f8f0-f85d-42a0-9643-03cc534a047e service nova] Creating event network-vif-deleted:02102235-a784-476e-808f-741130b4cc22 for instance 465ec313-e2c3-4a5d-a27e-2916b894353f on hv-cinder-81708 Nov 11 01:19:18.648115 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-d45ab4b8-da8d-4785-bc61-028be45e7726 req-14d5f8f0-f85d-42a0-9643-03cc534a047e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030334 Nov 11 01:19:18.648980 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 700/1386] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:19:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:19:18.900591 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:18.901201 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:18.907719 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:18.908165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:18.908952 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:18.909389 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:18.972444 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:19:18.979961 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-e9f8d728-0147-4647-8ac1-2c262026e842 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 200 len: 1225 microversion: 2.1 time: 0.083675 Nov 11 01:19:18.980540 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 687/1387] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:18 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:19:19.997932 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:19.998624 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: 465ec313-e2c3-4a5d-a27e-2916b894353f] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:20.004637 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:20.005077 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:20.005837 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:20.006263 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:20.018914 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] HTTP exception thrown: Instance 465ec313-e2c3-4a5d-a27e-2916b894353f could not be found. Nov 11 01:19:20.019518 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Returning 404 to user: Instance 465ec313-e2c3-4a5d-a27e-2916b894353f could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:19:20.020323 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a34bb0fe-319e-45da-b7a8-78563d14013b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f" status: 404 len: 111 microversion: 2.1 time: 0.027218 Nov 11 01:19:20.020842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 701/1388] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:19 2021] GET /compute/v2.1/servers/465ec313-e2c3-4a5d-a27e-2916b894353f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:19:23.057883 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:23.058432 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:23.060650 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-b14abe6c-6370-4f2c-9d7b-d7caba4813b8 req-81d59a29-a9ff-4d04-9bdf-7af63feb1c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78ccef4-9081-4590-b094-3b8cbd532a07", "tag": "c47d9952-985e-44f1-829a-36e30c6284d3"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:19:23.062191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:19:23.062191 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:19:23.064778 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:23.065226 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:23.066013 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:23.066669 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:23.070153 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-b14abe6c-6370-4f2c-9d7b-d7caba4813b8 req-81d59a29-a9ff-4d04-9bdf-7af63feb1c96 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:23.070672 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-b14abe6c-6370-4f2c-9d7b-d7caba4813b8 req-81d59a29-a9ff-4d04-9bdf-7af63feb1c96 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:23.082794 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-b14abe6c-6370-4f2c-9d7b-d7caba4813b8 req-81d59a29-a9ff-4d04-9bdf-7af63feb1c96 service nova] Creating event network-changed:c47d9952-985e-44f1-829a-36e30c6284d3 for instance e78ccef4-9081-4590-b094-3b8cbd532a07 on hv-cinder-81708 Nov 11 01:19:23.089041 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-b14abe6c-6370-4f2c-9d7b-d7caba4813b8 req-81d59a29-a9ff-4d04-9bdf-7af63feb1c96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031978 Nov 11 01:19:23.089750 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 702/1389] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:19:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 01:19:23.095555 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Going to try to terminate instance {{(pid=116015) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 01:19:23.187696 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-711946dc-fb30-437f-9ef2-8bddc5b7ba1f tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 204 len: 0 microversion: 2.1 time: 0.133133 Nov 11 01:19:23.191453 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 688/1390] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:19:23 2021] DELETE /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 01:19:23.197298 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:23.197993 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:23.204165 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:23.204874 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:23.205869 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:23.206498 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:23.349374 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.policy [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116016) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:19:23.356913 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-a7218029-0c5c-42d4-b77a-da636d70336c tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1577 microversion: 2.1 time: 0.164168 Nov 11 01:19:23.357487 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 703/1391] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:23 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:19:24.374735 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:24.375529 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:24.381695 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:24.382140 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:24.382917 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:24.383462 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:24.522164 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:19:24.530214 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-9d739872-5b30-4c0c-b99e-eb8e786364ae tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1458 microversion: 2.1 time: 0.159306 Nov 11 01:19:24.531284 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 689/1392] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:24 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 01:19:25.297811 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [req-e2487b7d-802a-4b62-a57d-ed2ca2a9f87c req-f09f42b4-26d0-49f2-b364-4fe40c81dab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78ccef4-9081-4590-b094-3b8cbd532a07", "name": "network-vif-deleted", "tag": "c47d9952-985e-44f1-829a-36e30c6284d3"}]} {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 01:19:25.299512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 01:19:25.299512 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: warnings.warn(msg) Nov 11 01:19:25.307668 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-e2487b7d-802a-4b62-a57d-ed2ca2a9f87c req-f09f42b4-26d0-49f2-b364-4fe40c81dab4 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:25.308109 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [req-e2487b7d-802a-4b62-a57d-ed2ca2a9f87c req-f09f42b4-26d0-49f2-b364-4fe40c81dab4 service nova] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:25.320871 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.compute.server_external_events [req-e2487b7d-802a-4b62-a57d-ed2ca2a9f87c req-f09f42b4-26d0-49f2-b364-4fe40c81dab4 service nova] Creating event network-vif-deleted:c47d9952-985e-44f1-829a-36e30c6284d3 for instance e78ccef4-9081-4590-b094-3b8cbd532a07 on hv-cinder-81708 Nov 11 01:19:25.327889 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [req-e2487b7d-802a-4b62-a57d-ed2ca2a9f87c req-f09f42b4-26d0-49f2-b364-4fe40c81dab4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Nov 11 01:19:25.328475 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 704/1393] 10.222.0.52 () {64 vars in 1317 bytes} [Thu Nov 11 01:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 01:19:25.551242 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:25.552090 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:25.561629 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:25.562088 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:25.562935 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:25.563398 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:25.627465 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.policy [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230522c86cb54917b908407ff521aab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7768097cddbd4bfd856d852e06732b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116015) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 01:19:25.635404 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-bdd413a3-81bf-49dc-a5da-0b8dd5422307 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 200 len: 1225 microversion: 2.1 time: 0.089002 Nov 11 01:19:25.636001 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 690/1394] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:25 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 01:19:26.651554 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:26.652249 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: e78ccef4-9081-4590-b094-3b8cbd532a07] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:26.658628 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:26.659112 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:26.659885 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:26.660315 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:26.672902 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] HTTP exception thrown: Instance e78ccef4-9081-4590-b094-3b8cbd532a07 could not be found. Nov 11 01:19:26.673477 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Returning 404 to user: Instance e78ccef4-9081-4590-b094-3b8cbd532a07 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:19:26.674321 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-61f12849-fd3f-44bd-9398-5155f7aa53ad tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07" status: 404 len: 111 microversion: 2.1 time: 0.026925 Nov 11 01:19:26.674842 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 705/1395] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:26 2021] GET /compute/v2.1/servers/e78ccef4-9081-4590-b094-3b8cbd532a07 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:19:27.123588 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:27.124089 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.compute.api [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116015) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:27.130269 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:27.130705 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:27.131503 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:27.131929 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG oslo_concurrency.lockutils [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:27.146132 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.wsgi [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] HTTP exception thrown: Instance b6f7b672-d2b8-4b4a-afae-27badff30668 could not be found. Nov 11 01:19:27.146701 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Returning 404 to user: Instance b6f7b672-d2b8-4b4a-afae-27badff30668 could not be found. {{(pid=116015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:19:27.147530 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-b5360401-e73b-40a9-8fbf-f6046f8dfc7b tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 404 len: 111 microversion: 2.1 time: 0.027648 Nov 11 01:19:27.148038 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 691/1396] 10.222.0.52 () {58 vars in 1238 bytes} [Thu Nov 11 01:19:27 2021] DELETE /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:19:27.156517 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '>' {{(pid=116016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:27.157130 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.compute.api [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] [instance: b6f7b672-d2b8-4b4a-afae-27badff30668] Fetching instance by UUID {{(pid=116016) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 01:19:27.162883 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:27.163357 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:27.164126 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 01:19:27.164558 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG oslo_concurrency.lockutils [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Lock "aa66ac5b-57b2-41b4-a4e6-eb99bac6c6e4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 01:19:27.177805 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.wsgi [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] HTTP exception thrown: Instance b6f7b672-d2b8-4b4a-afae-27badff30668 could not be found. Nov 11 01:19:27.178379 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: DEBUG nova.api.openstack.wsgi [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Returning 404 to user: Instance b6f7b672-d2b8-4b4a-afae-27badff30668 could not be found. {{(pid=116016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 01:19:27.179222 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO nova.api.openstack.requestlog [None req-0df7c5c8-d368-4ef0-b1ed-6a2ff2550f40 tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668" status: 404 len: 111 microversion: 2.1 time: 0.026476 Nov 11 01:19:27.179734 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: [pid: 116016|app: 0|req: 706/1397] 10.222.0.52 () {58 vars in 1235 bytes} [Thu Nov 11 01:19:27 2021] GET /compute/v2.1/servers/b6f7b672-d2b8-4b4a-afae-27badff30668 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 01:19:28.456908 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: DEBUG nova.api.openstack.wsgi [None req-2a9791a5-088e-4083-86b8-e6423cb700ed tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] Calling method '.version_select at 0x7fd3681beee0>' {{(pid=116015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 01:19:28.479158 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO nova.api.openstack.requestlog [None req-2a9791a5-088e-4083-86b8-e6423cb700ed tempest-TestVolumeBootPattern-2078081265 tempest-TestVolumeBootPattern-2078081265-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1629511064" status: 202 len: 0 microversion: 2.1 time: 0.025867 Nov 11 01:19:28.479740 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: [pid: 116015|app: 0|req: 692/1398] 10.222.0.52 () {58 vars in 1262 bytes} [Thu Nov 11 01:19:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1629511064 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 01:22:08.727393 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:22:08.728029 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: Thu Nov 11 01:22:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:22:37.391301 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:22:37.391901 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:22:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:22:37.453707 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:22:37.454268 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: Thu Nov 11 01:22:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:22:46.212009 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:22:46.212550 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:22:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:24:37.357474 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:24:37.358165 dv-cinder-817085-3-iscsi devstack@n-api.service[116015]: Thu Nov 11 01:24:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 01:24:39.823444 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 01:24:39.823892 dv-cinder-817085-3-iscsi devstack@n-api.service[116016]: Thu Nov 11 01:24:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!